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ABSTRACT 

several standard measures of aptitude, interest, 
attitude, and persona lit v are briefly described, including the 
General Aptitude Test Batterv, the Clerical skills Tests, other tests 
sponsored by the Onited States Employment Service; and the Strong 
Campbell .Interest Inventory. This volume also revievs special 
assessment techniques for the severely disadvantaged including 19 
paper and pencil measures, 13 work sample systems, and two pretesting 
. orientation exercises. Each '-eview outlines format purpose, 
development, intended audience, norms, validity, reliability, 
application to an employment and training setting, and availability, 
some tests, like the Nonreadlna Aptitude Test Battery and the Basic 
Occupational Literacy Test, have teen extensively ncrmed and 
validated with disadvantaged populations: others have not involved 
this group at all. (The appendix describes relevant reference works, 
and information services, ^ (CP) 
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I. STANDARD ASSESSMENT TECHNIQUES 
FOR EMPLOYMENT AND TRAINING AGENCIES 

Emphasis of (his Section 

In this section, a brief description is given of standard measures of work- 
related aptitudes, interests, attitudes and personality characteristics. The sec- 
tion is short because primary information about these instruments is readily 
available elsewhere. The instruments mentioned here, however, are among 
some of the best validated psychological tests in exi.stencc. and they have broad 
uttltty in employment and training settings. When clients have the required 
reading ability adequate prior experience with tests, and are not significantly 
handicapped by test anxiety or negative attitudes, the instruments described 
here may be e.xcellent choices. Certainly they need to be considered as alter- 
natives, even m programs serving primarily-but not exclusively-severely dis- 
advantaged clients for whom these instruments would not be appropriate 

Not described in this section are paper-and-pencil and projective test mea- 
sures ot P;y;;hopathology. such as the Minnesota Multiphasic Personality 
Inven ory (MMPI) and the Rorschach. In the writer's judgment, these clinic- 
ally ba.sed test instruments are inappropriate for all but a very few employ- 
ment and training agency assessment programs. If a significant focus of the 
employment and training agency is on clients who are or were mentally dis- 
turbed (e.g. ex-memal-hospital patiems). /then such instruments might be 
valid parts ot an assessment program. In /such instances, assessment would 
need to be planned for. and conducted in close coordination with, a clinical 
psychologist or other professional appropriately skilled in the administration 
scoring and interpretation of such clinical diagnostic instruments. These aoDli- 
cations are beyond the scope of this Martual. although references are provided 
in the appendix of Volume I that would be useful for designing such a psycho- 
pathology-oriented assessment program. 



Brief Review of Standard Assessment Techniques 

I'nited .States F.niplo>ment .Service. The history of the U.S. Employmem Ser- 
vice s occupational tcM -development program is well documented in their Test 
Research Report So. 31 (US DOI.. i977a). This publication gives the rationale 
behind the entire USliS test-development program and also provides descrip- 
tions ot the major instruments now available from USES: 

• The General Aptitude Test Battery (GATB) measures the vocational apti- 
tudes ot individuals who have basic literacy skills but need help in choosing 
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an occupaiion. It consists ot* 112 tests measuring 9 vocational aptitudes. A 
Spanish edition is also available (see below). The OATB was published in 
1947 after extensive occupationHl validation and factor analytic studies con- 
ducted during the 193(K and 194(K. This research program has continued 
through the present and i^ described in the Manual for (he General AptUiuie 
Test /f<;/rm (Seciion III: Development; US DOl » 1970a). 



• Specific Aptitude Test Batteries (SATBs) measure the potential of individ- 
uals to acquire skills required for a specific occupaiion. SATBs are con^bina- 
lions of iwo» three or four GATB aptitude subtests, with associated 9lming 
scores derived from research relating test scores to successful performance 
in the given occupation. More than 450 SATBs have been developed to date 
(US DOL. 1970a). 

• Clerical Skills Tests measure proficiency in typing, dictation and spelling to 
determine qualifications for clerical jobs. Content validation was chosen as 
the primary validation strategy for demonstrating job-relatedness, since 
these tests are work samples. 

Essential knowledge and skills needed in typing, secretarial and steno- 
graphic jobs are sampled in the typing and dictation tests through the use of 
letters taken from actual correspondence in variou3 industries. Contents of a 
general spelling test» a statistical typing test» and medical and legal spelling 
tests were also chosen to sample essential knowledge and skills needed in 
performing these clerical tasks. Detailed information on the validity, reli- 
ability and standardization of these tests on appropriate samples of 
employed workers is in the Manual for USES Clerical Skills Tests (US DOL, 
1976). 

• A revised Interest Check List, oriented to the new Department of Labor 
Guide for Occupational Exploration, has been developed for use in obtain- 
ing information on the range of occupational interests of a counselee. It 
consists of 20 work activity items selected to reflect jobs in each of 66 work 
groups representing 12 major interest areas described in the Guide for Occu- 
pational Exploration. 

• The Bateria de Examenes de Aptitud General (BEAG) is a Spanish edition 
of the CjATB* designed for use with Spanish-speaking applicants. Studies 
comparing G.ATB and BEAG scores and a nationwide operational tryout of 
the new battery have been undertaken by USES. Test materials and a manu- 
al (US IX)l.. 1977b) now ar' available for use by state Employment Services 
hav ing Spanish -speaking applicants. 

Research by USES is under way to develop an interest inventory oriented 
toward the fourth edition of the Dictionary of Occupational Titles and to the 
new Guide for Occupational Exploration (a supplement to the DOT), The 
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\^ T' ''^"^''^ o^-^upational titles and 

l.te experience iicm. Ihero svill be 12 scales .hich will correspond to 12 mter 
est areas .mo uh.ch fourth edition DOT occupations have been classified in 
the /„r Occupunonul Exploration, lied in with this test -development 

activity .s a revision of the UShS /merest Check List. The design of these 
research activities is reported in DroegeA Hawk (1977) and Droege(1978) 

''^ ^'ATB are being devel- 
'•^'^^'.i^^'^'d '"inority populations (thus making these 
I StS ins.ruments more useful with severely disadvantaged populations) and 
there is an entire USFS research effort directed toward the development of 
ScIJtlon la' '"''^"^'^^ '"^^^ ''■''^ ''^''^^^y disadvantaged (see 

Str«n«-C amphdl Interest Inventory. Mm ,cst is described in detail in its test 
manual (Cainpbell. 1974) and also in Buros' Eighth Xfental Measurements 
h'^r/.«,A Ihe best validated vocational interest test in existence, the Strong- 
Campbell has broud utility for determining areas of occupational preference 
tor indu iduals who are able to complete it validly. It often may be used in con- 
junction with an aptitude test, such as the CiATB. to provide a great deal of 
spcvmc .ntonnation useful for vocational counseling and in making training 
or placenient decisions. * 

Other aptitude, interest and personality tests. A large range of occupationally 
rdatcd assessment instruments have been used in employment and training set- 
tings. A tew ot the most frequently employed tests are the Kuder Preference 
Rccx>rd. Minnesota Vocational Interest Inventory. Bennett Mechanical Com- 
prchensu>n lest F lanagan Aptitude Cla.ssification Test. Wechsler Adult Intel- 
.gence Sea es. l-dwards Personal Preference Schedule, and Sixteen Personali- 
ty l actor Questionnaire. Appendix B may be consulted for details on how to 
acquire more information about such techniques, most of which are readily 
available throuir'.i commercial test publishers. 



II. SPKC IAL ASSKSSMKNTTKCHNIQUES 
FOR THF SKV KRELY DISADVANTAGKD: A REVIEW 

iCmphasis of this Section 

The need for special assessment devices for Severely disadvantaged individuals 
m local omploynK-nt and training agencies is by now well known, and it seems 
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almost incredible thai iradiiional paper-and-pcncil tests continue to be used. 
Yet tests such as the GATB. Strong-Campbell Interest Inventory, Edwards 
Personal Preference Schedule, and Minnesota Multiphasic Personality Inven- 
tory (MMPI) do continue to be used— inappropriately— with seriously disad- 
vantaged persons in many client assessment programs. This chapter is designed 
to present a catalog ot alternatives for severely disadvantaged populations. 
Some were created specifically for use in employment and training agencies; 
others were not, but appear to have potential for adaptation. 

Disadvantaged individuals frequently have had little exposure to traditional 
paper-and-pencil tests; reading and arithmetic abilities may be limited. To the 
extent that "test wiseness" and numerical or reading skills are important in 
test performance, scores on a test like the GATB may suffer— but these handi- 
caps to test performance may or may not be factors that would also hinder job 
performance. If an examinee cannot read and understand test directions or 
individual items, he will perform poorly regardless of his real capacity on the 
aptitude being measured. Test performance will predict job success, however, 
only if (a) the person really is low on the aptitude under consideration or (b) 
reading skills themselves are important to job performance. Thus, a potential 
auto mechanic who is functionally illiterate may perform quite poorly on a 
paper-and-pencil test of numerical reasoning, not because he or she lacks the 
capacity the test is intended to measure, but rather because the mode of assess- 
ment does not permit his or her characteristics to be tapped in a relevant man- 
ner. It is ironic that, with some exceptions, ihc greater ihcuc^d of the client for 
employment and training services, the less useful is the GATB for assessment, 
since me most pervasive characteristic of cultural disadvantagemeni is educa- 
tional deficiency. 

The Strong-Campbell Interest Inventory and the MMPI present similar 
kinds of problems in terms of item content, format and directions, and so 
forth. On all such tests, there is great difficulty in obtaining valid and mean- 
ingful results (on a test designed for and normed on individuals of high-school 
literacy) when the test is administered to disadvantaged individuals of fourth- 
grade literacy who cannot understand half the words on the test. At the very 
least, when instruments designed for a high-literacy subject population are 
applied to a low -literacy une, every measure becomes in part a test of vocabu- 
lary and readinji skills alone. Those who do well are reasonably literate and, in 
addition, may rank high in the characteristic being measured (assuming test 
validity with appropriately literate subjects). Those who score low may be low 
on the abilitv which the test purports to measure, in reading skills, or both. 

On interest and personality inventories, where there are no right or wrong 
answers in the tradiiionul sense, the results can be even more ambiguous. In 
slion, if an examinee cannot understand a test item or test direction, he or she 
cannot be expected to respond meaningfully. Tlie problem is compounded by 
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the loading of cultural experience ,n many test items and by the anxknv 
V7 ) ||, the essen nal point about ailuue-bound tests by ••turning the 

Vidua!? uiscnminate against many white, middle-elass indi- 

1. I. Hone Walker" ijol tanious tor playing 

a. trombone 

b. piaiio 

d. guitar 

e. hanihor.c 

A "^'as Head" IN a person who has a 

a. fast moving car 

b. stable of "lace" 
"process'* 

d. habit of stealing cars 
t'- long jail record for arson 

.V If a man is called a **Blood;' then he is a 
d. boxer 

b. Mexican-American 

Negro 
d. :uingr> hemophile 

red man or Indian 

4. -Bird" or "Yardbird'* was the -jacket^ that ja// lovers 
from coast to coast hung on 

a. 1 ester Young 

b. Dorothv Armstrong 
Hilh "the I ion" Smith 

d. C'h.trhc Parker 

e. Muggsv Spanier 

y Cheap chitlings (not the kmd you buy at a t'w^^n-food 
counter) w,|| taste rubbery unless thev are cooked long 
enough fKm soon can you quit cooking them to eat and 
enjov iheiti? 

a. 4^ nnnuiL-s 
b 2 hours 
V* 24 hmirs 

d. 1 week (on a low ll.une) 
e 1 hour 
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6. Who did ''Stagger l ee" kill (in the famous blues legend)? 

a. his cousin 

b. Frankie 

c. Johnny 

d. his girl friend 

e. Billy 



Examples from standard aptitude, personality and interest tests that would 
present similar problems to culturally disadvantaged subjects couid be given 
by anyone who browses through these instruments. 

Some of the shortcomings of traditional paper-and-pencil tests, briefly sum- 
marized, are as follows: 

• Most traditional paper-and-pencil tests are similar to classroom examina- 
tions with which many seriously disadvantaged persons have a history of 
failure, and which, therefore, may make them feel anxious and uncomfort- 
able. 

• Many of these tests have written directions at a rather high reading level 
which must be understood by the testee if measurements are to be valid. 

• Individual test items also may be at a relatively high reading level and may 
reflect cultural content of which the disadvantaged have little knowledge. 

• Item content of tests designed for children but administered to disadvan- 
taged adults may be simple enough in reading level but uninteresting or 
insulting. This can greatly damage motivation to perform. 

• Many severely disadvantaged persons have limited experience with tests of 
any kind and so do not have the **test wiseness** important to yielding test 
results that fairly estimate characteristics/capabilities. 

• Many tests do not seem to bear any significant relationship to the individual 
characteristics pertinent to job success for most of the jobs the disadvan- 
taged will be seeking. 

The rest of this section presents descriptions of several dozen assessment 
techniques that may be useful in assessment programs for local employment 
and training agencies which serve significant numbers of the seriously disad- 
vantaged. Before moving to a description of how this catalog of assessment 
techniques is organized and presented, it is first necessary to offer several cau- 
tions about how this information should be used. One is that, as mentioned 
above, almost any employment and training agency will serve some clients who 
are not significantly enough disadvantaged that they cannot be assessed well 
with the standard instruments. For those able to complete it validly, the 
Strong-Campbell Interest Inventory may be a much better choice than the 
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viK-aiional imcresi na-asurcs coniai„ed in .his ca.alog. Similarly for subiccis 
pc.«o«,„g ,h. required skills and background, the CiATB is ^WghTy sensWve 

.noLl!eJook«l^onjLs_dgnung ihe luiiils fur whal should be included in an 

me, : i:^::d h'.r."h"* '~ ' l:" 

^Xi^llalttnt^'dr "-^^ - 

insfrrenis't;!;;:: 'r^^N^iv m«T;d'''"'"T'r "^'"^"^ "^""^ 

. . ^'^^ nt)l r. and some of the work samnle svs- 

on s. have been extensively nornied and validated with disadvantaged popula- 
t oMs and may be mstalled in some cases without significant adaptat on Many 
otho instruments hsted here, however, are still in relatively early stages of 
•development; some have not been field tested with seriousfy di^advan^^^^^^^^^^ 

dSnr 1 1 '"^'^^^^•'^ '^'^ asseLmen program 

t S nT ? mstrumonts or techniques in this catalog as an inspiration 

i d^eMn nl ' '^''^^'''^ "^^ ^hich assessment tools can be selected 
and su m place in an assessment program without careful e, .mination local 

:::2:Xr:::;^r' - ^ ^^-^^^^--^ organi.ed;:;;Jran 

nienJ^rfJiam^T' ^'^^^'^^P'"« « 8^0^ assess- 

n en program. This reality was already evident in the descriptions of assess- 
ment programs presented in Section II of the first volume Therefore the 
' ier or this catalog should be looking for ideas, for useful comronen s and 
progranr""^ dev.ces that fit into the overall context of a careful designed 
tach capsuL' review here follows a standard format: 

• nrthoh lYsr 

• IHscRipi ioN— what kind of device it is 

' s'c^rrn'J;;'^?, (sometimes with sample items), administration time, 

scoring procedures ' 

• SrA(;K o^ .>fvfiopmfn i-how and why the test was created, where it has 
beer ..sed what kind^ of populations have taken it. and what kinds of nor- 
mal, vc. rehabihtv and validity evidence are available 

• AHFi icAr.os- A critical evaluation of how the device might be applied in an 
employment and training setting 

Acc Fss-hou to get a copy of the assessment device and/or more informa- 
lion about u 

: availabiliiv of information to include under these ,eadings varies of 
trotn device to device. Prices are not given because inflation would 



The availabilit 
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make such data invalid before this volume was published. 
The catalog has three main seciions: 

• paper and pencil devices (including aptitude, interest and personality or 
attitude measures) 

• work sample systems 

• pretesting orientation materials 

Presentation is alphabetical by title within each main category. 

A very few of the assessment strategies or devices presented in Backer (1972) 
have been deleted from this list, such as 0*Mahoney*s Self-Concepts Profiling 
Technique, and Daane's Vocational Exploration Groups. The reader is 
referred to the earlier publication* for discussions of these two approaches 
and also for coverage of topics such as job-man matching and criteria devel- 
opment « 



Catalog of Assessment Techniques 

PAPKR-AND-PENCIL DEVICES 
Ti n h Ihsr: Adult Basic Learning Examination (ABLE) 

DF.scRiprioN: Measure of basic learning skills, using subject matter drawn from adult 
life 

hoKMAf: The test includes a vocabulary test, dictated so that no reading is required; an 
arithmetic problem-solvmg test, which can cither be dictated or taken in conventional 
reading and response format; and a short screening test, called ''SclcctABLE'* for use 
in determining the most appropriate level of ABLE for each adult applicant. Three 
levels of the ABl E battery are available, each geared to a particular educational level. 
I evels One and Two require about two hours' administration time, and Level Three, 
about three hours. Svormg can either be by hand or (for Level Three only) through the 
publisher's computer scoring service. 

SiA<iF Oh Dt-vi-ioPMi-Nr: ABl E was developed to provide a general intellectual apti- 
tude screening tool for use with disadvantaged adults, one that overcomes the tradi- 
tional shortcoming of tests for low reading level involving items geared to children 
rather than adults. I xicnsivc normative data and a test manual are available from the 
pubhsher although there is no mention of the availability of validity data. 



•\vujlahlc tfom the Nanonal lechnical Information Service. U.S. Department of Commerce, 
SprmgHeU. \A ::iM .Vvession No. PB'2I3167/AS. 
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API.. U Ar...N: Ocneral screening for determining training needs or placement options 
Mckss: Available from the Psychological Corpc>ration, New York 

• • • 

Tiri fc Thsi : Basic (kcupalional l iteracy Test (BOIJ) 

idTaZ^^^^^^^^ ^^'"^ -ith educationally dis- 

FoRMAr: on the BOl.T. reading skills are assessed by a reading vocabulary subtest and 
a reading comprehension subtest; arithmetic skills are assessed by anVr thr^et ^nm 
putafon subtest and an arithmetic reasoning subtest. T subtes s ar^ S^^^ 

::;n:r :r"^^^^^^^ -^^^ ^^-^^^ ^> or b/^in^tt:: 

h.'m r. ""^^ ^''^ '^•^^•^'OP*^'' 'o •""''"re aptitudes using test- 

.cm content that .s relevant for adults rather than children. The BOLT wide ran«e 

m In Z Zlr""'' "^'-^ ^^o""' administered to Igiven cU 

em In he BOIT manual (1972). detailed information about test development no - 
ma..vedata. rel.ab«lity data, and an in -progress validation program are given 
AHPiK-AnoN: General screening for determining training needs or placement options 
Acc fcss: Information on availability of the test, answer sheets and test manual as 
well as he w.de-range scale for determination of appropriate BO^T subteTts can be 
obtained from state Kmployment Service offices. ' 

• • • 

Tiru Oh T>.sr: BioRraphical Informalion Blank (BIB) 

IHscRiPnoNiBriefquestionnaireeliciting autobiographical data from the examinee 
roRMAr: The BIB is a questionnaire form containing, in its present stage 66 items of 
biographical information in the following categories: home and famir'madon-Ls 
anJ present; high school experiences and perceptions; work history i cl dingTob turn 

>ng N^ork the work place and income; life goals and philosophy; self-image- and time 
organi/ation habits. Items were specifically constructed for use'.vhh Sets reading 

oJ) X vrr'ili^T^ ''T "^^-^'^'^^^ '^^'^ ^ 

in X he' e arc n.^;,t n '^^^^^ - hand, 

sin.e there arc no right or wrong answers in the traditioTal sense. those havinn nenative 
experiences with tests may be less threatened by the BIB. Tl e Sb caTbeTo^ed 
routine!) by clerical personnel using .scoring keys developed by the test's creators 
•STAciF DtvtioPME.Nr: The BIB was developed under a research contract from the 
Department of I abor by Richardson. Bellows. Henry & Company. Inc. (RBH and hS 
been used in predicting length of participation in the Job Corps (RBH 1 970 nd for 
predi ting ,ob tenure among Employment Service applicants (RBH. 1971) In a study 
completed in .975. the BIB was used to predict (1) three-month emplo L t t ur . 



among disadvanidged i-fiu .o^ nicni Service (HS) applicants who had received no previ- 
ous emplo>meni and i.^Miing agencv services prior lo job placement, and (2) comple- 
tion or job entry stages among Work Incentive (WIN) program enrollees. Results of 
this studv indicated that persons scoring higher on the BiB were more likely to remain 
employed or to ^.omplete job entry on the WIN program at significantly higher rates 
than those m the lower score groups. The most recent form of the BIB was used in a 
study by RBH (1^79) to determine operational utility of scoring keys developed in the 
previouslv mentioned work. This study involved administration of the BIB to incoming 
WIN registrants in U) cities. Again, there was a strong correlation between BIB score 
and WIN outcomes in the participating cities. In this study, it was also found that the 
success levels (percent employed) of the cities which reported actually using BIB scores 
in making program decisions were substantially higher than those which did not. In 
fact, the average percent employed was almost twice as high for the **use cities.'' 

The 1^79 RBH report concludes by recommending that WIN use BIB to help identify 
persons most likely to Hreak out of the welfare cycle if WIN assistance is provided. A 
scoring key developed through the HBH research is recommended for this purpose. 

In the various research reports mentioned in this 'description, substantial evidence 
about the reliability and validity of the BIB is available, along with some normative 
data, 4^ 

Appiu Aiu)N. RBH advised the use of the BIB as a tool for identifying those most likely 
to benefit from services in WIN programs; by analogy, other seriously disadvantaged 
employment and training agency applicants could be identified using such a system. 
However, there are still some problems with the BIB that employment and training 
agencies would need to consider carefully before making operational use of the instru- 
ment at this time, 

Hrsi, there was evidence, from RBH's own research, of reluctance by a number of 
the experimental participating cities in their 1979 study to use the BIB as a part of the 
service priKess. Clearly, substantial education of employment and training agency 
staffs may be required to convince those who would have to use the BIB that it would 
be likely to have value and togive them careful training in its proper use. 

Also. It is not clear from the research conducted so far whether the BIB is really 
picking out those individuals most likely to benefit from a particular service delivery 
process. 

In fact, because high scorers on the Bib may well be persons who would be likely to 
get a job even without receiving services, using the BIB as a selection tool (with a high 
score selecting into the program) may actually select for service those who need it least. 

Also, since the use and non use cities in the 1979 study were allowed to self-select, 
there is no reliable way to identify and measure what other variables may have been 
operating \\\ promoting a higher percentage of employment for those cities that used 
the BIB scores versu!^ those that did not. 

On the plus side, the BIB has now been administered to a very large group of seri- 
rusly disadvantaged individuals. It has been refined a number of times, as have its 
scoring procedures. 

Aross- RBH has prepared a questionnaire booklet (known variously as Registrant 
Record or BIB) and a scaiinable answer sheet. Its research reports contain considerable 
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rdiabilny and vaHdi.y data. Richardson. Bdlows. Henry & C ompany. Inc. is located 
at 1 14()< onnocticut Avenue. N. W .. Washington. DC Hxm. 

• • ♦ 

ImK)f IhM:('uloraduBall«r> 

lah iru'"";' ^'^^^'iopcd by the C'olorado State University Manpower 

Laboratory tor use in work with the severely disadvantaged oianpower 

soZk V?-^r"' "f u>nta,ns 89 items nieasuring six per- 

n H . ^-^^'''.''ns questions about personal history. Items are either 

" Ic .ho.ce or use a bipolar a.ree-d.sagree answer scale. This test was designed to 
ap soc.;,| and personahtv characteristics that contribute to "job deviance" Subject 

2 ^/t- a 47.|,,n, questionnaire dealing with behavior on the job and is designed to 
e su.e the consequences ot dif fering vocational attitudes amo g worker, sJoe iso^ 
a d etnplover. I he f.,nonance Ques„onna,re is a .est of 20 items relating ,; obZdT- 
u s or opportunities, each rated on a scale of from very important to very unimp^- 
lu- t-n^ o.r,en, Suusfacuon Quesnonnu,re has 20 items measuring job satis^S- 
t.on on a s.ale from very unsatisfied to very satisfied (items were taken from the Min- 

r:;«i, jo, con,uu>ns qZI^. 

t^fZ^^T r" ^'''^ environment. The Job t^pec 

Cd.tun s Ih r,^^'-''^' ''^^^ ^-^^'"-'ion by workers of si.x basicTob 

o,d,t.ons. Ihe 7./, /../'or^^^.v Prec/icnon Scule is a l2-itcm scale filled out by 
workers and supervisors to check for congruences and discrepancies between tSe wo 
gro^.ps regarding important job conditions. The SeU-AccepJce Q.es,,JaZZ ^s 
. cm ycs-no Pleasure of highly loaded self-evaluation items, e.g. concerning respon- 
do,u s sexual behavior. The S..nlan,y Scale is an 80-item checkfis measuri g identm- 
cation with militant or activist groups. luentiii 

WW n!' '1 ^'"7- ''''^'^ \t>sk,min.s Self. Goal-Other Discrepancy Scale 
AfA/.S(,(> . which was discussed in Backer (1972) as being inappropriate tor use with 
the severely disadvantaged -and it. therefore, will not be discussed here 
r u .T'iu^'iTk '"Mruments are presented in a ResearchManual (Manpo^. er Labo- 
ur .it id' ''''' -"-"'"^ 

stt u.turc. .ntuided use. mode of administration, and reliability and validity data. 
nlZ.,ll^V^;^"' ""'"'r'"'^ -.re developed under funding from the 
f.K d rese.irch pro,ect called -Applied Programs ,n Manpower Development." To 
t::Zn^'- ''-"''''^ ^ase'supporting 

':;::e:;,^n:;r:i;:;::^^^^^^^^^ ^^^^-^ ^^"--"^ - - ^or 

l^'.h !r"; V/"'' r' " 'f'^- Department of 

aK r or hrough use ot one of the computer-assisted information retri;val svstcm 
me.K.oned in the Appendix of Volume 1 of this Manual. 



ERIC 



16 



Tint OF Thsx: Fundamental Aihlevement Scries (FAS) 

Description: Two tape-recor<led tests for use with individuals having limited reading 
skills, tapping knowledge and capabilities that an applicant may reasonably be 
expected to have acquired in the course of ordinary daily living 

Format: The FAS-Verbal is a 30-minute test; it measures the ability to read signs, use 
telephone directories and recogni/e and understand commonly used words. The FAS- 
Numerical also take?. 30 minutes to administer; it measures the ability to tell time, rec- 
ogni/e numbers, understand calendars and solve numerical problems. The tape record- 
ings insure accurate timing and identical presentation to all who take the test, elimi- 
nating examiner bias. Integrated question booklets and answer sheets are provided. 
Scoring procedures and other details administration are presented in a manual avail- 
able from the test publisher 

S\Ai\h i)h lH.vnopM^^T: The Fundamental Achievement Series was developed for use 
in selecting applicants for job-training programs and covers the range from basic liter- 
acy to slightly above the eighth-grade level. Information on normative, reliability and 
validity data is available in the publisher's manual. 

AppncATu^N: Ferine as a4aa:*ic Kreemng device in employment and training agency 
service programs 

Acci-ss. .Available from the Psychological Corporation, New York 



• • • 



IiTiK)!^ Ust (iATB NATBScreeninR Device 

IHscRipnoN: A brief written test consisting of the wide-range scale of the Basic Occu- 
pational I iieracv Test (described above) for use in determining whether a particular 
service applicant ^lould be given the GATB or NATB 

I'ORMAt: The test consists of arithmetic and vocabulary items and is scored using two 
stencils. Further information on administration and scoring procedures is available in 
the Manual for the GATB SATB Sireemnfi Device (USES, 1973). 

SIA^l^ ()^ IHvuopmi-nt: Details on development and use of this device also are pre- 
sented m the 1^73 Manual. These include cutoff scores to be used in determining 
whether a given applicant should take the GATB or NATB. 

Appi iCAfioN: l-or emplo>ment and training agency assessment programs where both 
the Ci.M B and NAVB may be administered, to determine which test a given applicant 
should take 

Access: Information about availability of the test, scoring stencils and the Manual can 
be obtained from state Employment Service offices. 



• • • 

I'lri^ Of Tfsr: (ioodwin ^^ork Orientation Questionnaire 

Dkscrifi U)N ; Questionnaire designed to measure work orientations of WIN trainees 
12 
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h.KMA. : I he Work Onentat.on Quostionna.ie vvas devised to measure attitudes, goalsi 
beliefs and intentions ^nh respect to the world ot vvo.k. I he questionnaire consists of 
seveial sets ot quesiions about vvoik that are to be rated on tour-siop "ladders" ratm- 
m^. to, example, tion. "a.Kv'- to ••disagiee" Hoth a scll-administeriiii: lorm and a 
home-interview torm. with questions icad in the intetviewer. have been aeated. 

Mv.-i ,u Dtvii-v-MtM: i)ata have been jjathered on some 14(X) WIN trainees and 
weie tacto, analv/ed to vield cliiste.s o1 items detimn. work orientations, (ioodwin 
(IV hsu>.,.eMs that, with appiopriate refinement, the WoA Orientation Questionnaire 
•nigii be used lo help WIN statt acquire nioie accurate perceptions ot their trainees' 
vvotk oiientatioiis toi ^uhscqueni use m counseling and p,acemeni. 

Arm. viinN- Since this mstruineni was developed onlv in a preliminarv research 
studv and no eNtensnc lehabilitv oi validitv data are available, it should be considered 
piinuirilv as ., source ot ideas tor use in employment and training situations where 
nieasuiemeni ot woik oiienlaiion mav be important. 

A. . i ss: l opies ol the lesearch lepoit ate available liom l)i. I eona.d H. Ciooduin. 
Hie Hrookiniis Institution. Washington. D.C . 2(X).1h. 



, litn .IF l ist: Indik Uork Moti*atlon Scales 

l)i s< RiHuos: Interv lew -tormai test designed to estimate work motivation 
Jokvi.M: The interviewer reads a collection of statements and asks the interviewee 
whether he she agrees stronglv. agrees mildly, is undecided, disagrees mildly or dis- 
agrees stronglv . Also, data are collected by having the interviewee choose one of four 
possible endings to unfinished statements read by the interviewer. Si.x areas of motiva- 
tion are assessed: the motive to work, the motive to avoid work, the expectancy to 
work, the expectancy to avoid work, the incentive to work and the incemive to avoid 
work. In a research study. Indik (1966) found that these scales were modestly related to 
training and placement success for MOTA enrollees. An important finding was that the 
motivational characteristics that seem to facilitate stable employment are not necessar- 
ily those that facilitate success in training. No further work with this instrument appar- 
ently has been conducted, and normative, reliability and validity data are not available. 
Appi k Mins: Since this instrument has received only research use so far. it would pri- 
marilv be a source ot ideas tor employmenl and training agencies concerned with the 
measurement ot motivation to work, 

A.oss: Copies ot the research repo,i are available trom Dr. Bernard Indik. Rutgers 
I niversiiy. .New Brunswick. .NJ OHW.V 



I t ri KH I J s I : Joruensen Interpersonal Kelatiunships .Scales 

1)1 s. RiPiius- instruments designed for a research study of the relationship of 
interpersonal lacility to placement success 

13 
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FuRMAi : rhe Soaai Vwahularv Index consisis of six scales: ( 1 ) the SelJ Concepi Scale, 
a 20-iiem test ol opinions of self consisting ol statements beginning with "I am . . 
responses are chosen from trequcncv allJ*rnatives (most of the time— hardly ever); 
{2) ihc Si^lJAivefXame Scale, a 2(Mtem adjective check list; (3) the Ideal Self Scale mth 
the same items as the self-concept scale except that the statements ore stemmed 
>\ould like to be . (4) i oncept ot Others Scale with the same items but stemmed 
"Other people are . . (5) a \vcahularv Scale designed to measure subjects' reading 
comprehension: and (6) a Social lyesirahdity Scale consisting of 33 statements about 
personal behavior v^hich the subject is asked to rate true or false for himself. 

The Revised Interaction .Vca/f. the other instrument used in this study, is axwo-part 
paper-and-pencil questionnaire that is used by both counselor and counselee to rate the 
counseling interaction. 

SiAcii- Oh Di-vnopMi-Ni : In a study using the two instruments with rural rehabilitation 
clients (Jorgensen et al.. significant differences in test scores were found 

between females who obtained their own jobs and those who had placement assistance. 
These modest results suggest some possible utility of the measures for predicting which 
clients need placement sci vices. No other normative, reliability or validity evidence is 
available. 

Appiu ahon: Since this instrutuent has been used only in research, it would primarily 
be a source of uiectn tor einplovment and training agencies concerned with measure- 
ment of interpersonal relationships as a component of success in obtaining a job. 

A( ( tss: Ihese msiruments are available from Ci.Q. Jorgensen al the University of 
Utah, Salt I akeC itv. L tah H41 12. 



rm> Oh Ihsi: Mttndell N\(* Pro)(ram Interview Forms 

Dfsi kipmon: Interview forms designed to gather data about job perceptions of 
Neighborhood Youth C orp (NN C) enrollees 

Format: Ouesiions for enrollees are phrased in simple language in these instruments. 
Since interviews are conducted individually, the interviewer is permitted to adapt word- 
ing of questions to the respondent's levd of understanding. The forms used include a 
general section for all groups of subjects, with separate background forms for enrollees 
and supervisors and emplovers of NYC* enrollees studied in this research (Mandell, 
Blackman & Sullivan. One of the study's purposes was to compare enrollee per- 

ceptions with those of supervisors and employers. During the interviews, data were col- 
lected for the following variables from superv isors and employers: skills, tolerance for 
behavior vanabihtv. employer-employee relationship, supervisor-employee relations 
and employee benefits. 

SfAiih Oh DhvuopMi-Ni : These interview forms were developed for research uses only, 
and no vahditv. normative or reliability data are available. 

AppiuMioN I he potential utility of these survey forms for other assessment purposes 
does not seem to be very great, although they could be used in certain assessment pro- 
grams for obtaining perceptions of applicants regarding job-related variables. 
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wakolt Research C cuter. Statcn Island. New York. 

• • • 

I iiiM>M i st ; NonrendinK Aplilud« lesi BMltm (NAI B) 

surcd h> the (.AI B. It was developed tor use with iiidividuaN who do not have suifi- 
cieni Iiterao skills to take thetiAl B. 

»<.K.MAi: I he NAIB measures aptitudes in the following areas: intelligence, verbal 
aptitude. nu,ner..cal aptitude, spatial aptitude, form perception, clerical perception, 
motor coordination, tinger dexterity and manual dexterity. Apparatus tests are used 
for measuring linger dexteritv and manual dexterity, and the other test portions are 
designed lor paper-und-pencil format. It requires about 3'. hours tocomplete; some 
ot Its subtests involve no reading or vocabulary skills at all. Others use familiar 

""'^ ""^"^ ''^''^"•^'y 'li^advantaged should be familiar. 

I he N.AI H manual (I S IX)l . 1970b) contains information on administration, scoring 
and interpretation. Paper -and-pencil test booklets and answer .sheets are integrated 
and machine scoring is available through National Computer Systems in Minneapolis. ' 
StA<ih a, IHvuuHMFNf Ihe .NAI-B was originally developed in recognition of the 
shortcomings ol ihe CiAFB for use in employment and training agency services to the 
severely disadvantaged. Extensive normative and reliability data are available, and 
vaiiilitv studies have been under way tor some time. 

rAi'il' ^vru^ J^' " of choice, particularly when the 

(.AIH NAIB Screening Device is used, for seriously disadvantaged applicants in 
en,plo>,„ent and training agency service programs, where a general measure of intel- 
lectual aptitude is required. 

\i i hss: Information about availability of the NATO and associated manuals and scor- 
ing materials can be obtained from state Kmployment Service offices. 

• • • 

Iiiii i)h hsi Orui Directions lest 

l)»s, RicnoN. Direct measure of an applicant's ability to understand and follow oral 
directions 

f oRMM Ihe applK-aiu responds bv marking the answer document in accordance with 
instructions dictated on a cassette tape or r.-cord. It requires 15 minutes to a.lminister 
and IS alst> available in a Spanish-language version. 

S.M.i o^ n, w l(„.M^^,; Ihe Oral Directions lest v.as developed as an aid to selecting 
more able workeis .„uonc applicants having a limited education and among applicants 
with limiied i^novvledgc of I n^lish. According to the test publisher, it is suitable for 
selecting applicants for maintenance and service work in public institutions, transpor- 
tatioii sv stems, stoies. hotels, etc.. as well as m factories and shops, information on 
normative, rcliabiliiv and validitv data is available in a test manual. 
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Amic'ArioN: This test may have some applicability in employment and training agen- 
cies for use as a gene'-al screening device. 

A<'cts,s; Available Hum the Psychological Corporation. New York 

• • # 

TiTLK OF rtsr; Picture Interest K^ploratioii Survi^y (PII':S) 

DhsrRiprioN: A career mterest inventory presentedin a visual, nonreading format 

Format: The FIFS is designed to help in the investigation of individuals' vocational 
interests and to apply this information to pursuing career goals, A PIES test kit 
includes 160 color slides. 2 slide trays. 1 audio tape, 2 Wts of career reference cards. I 
student-teacher manual and 50 response Jiheets, Colored 35mm slides are utilized to 
depict 12 specific ci»ieers within each of 13 career clusters. The career-cluster system is 
based on the ikxupational Outlook Handbook and is cross-referenced to the Dictio- 
nary oj ikcuputional Titles. Each slide shows a worker's hands performing a task con- 
sidered to be representative of a particular occupation within a career cluster. Users 
indicate interest in a particular career by circling the number of that slide on their 
response sheet. The survey may be administered individually, in a group, or self- 
administered. Users may determine their own **score." or interests, by simply counting 
the number of items they circled and then determining which career cluster contained 
ihc most items marked. Because hands are depicted performing tasks, the developer of 
PIES claims a minimum of distraction or bias in occupational selection due to physical 
attractiveness of the workers or ethnic, sex or racial characteristics, 

STAciH OF DhVhLopMFsr: PIES has been developed primarily for use with adolescents, 
and a validation study (Eubanks. 1977) was conducted using this population. Norma- 
tive, reliability and validity data are available in Eubanks' report. Validity in the 
Eubanks study was assessed using a concurrent measure (comparison with other voca- 
tional interest test scores), and there is to date no concrete evidence as to the actual effi- 
cacy of PIES in predicting career selection or facilitating the career -cou»iseling process. 

Ahhiu Afios: Employment and training agencies dealing with youth service programs 
might consider using PIES as a career exploration or counseling tool although it lacks 
clear validity data. 

Act i-ss: PIES In available from Education Achievement Corporation. P.O. Box 7310, 
Waco. Texas 767 lo. 

• • • 

\\\\\r ^)^ Ihsr: FroKram for ,\ssessinK Youth Employment Skills (PAYES) 

I)^s^'RlPI!os: .'X batterv of seven tests designed specifically for u.se with disadvantaged 
youth in guidance counseling 

EoRMAr: PAVES consists of rhree separate booklets: Booklet ! contains three atti- 
tudmal measureN; Booklet 2. three cognitive ones; and Booklet 3, a vocational interest 
inveniorv. Job-holding skilK. attitude toward supervision and self-confidence are the 
three major attitude areas covered. Cognitive measures of job knowledge, job-seeking 

16 



2i 



skills and practical reasoning are also surveyed. The measures are designed for adoles- 
cents and voung adults ^ith km verbal skills; pictures help to clarify many of the ques- 
tions presented. Ihe pictures in this -unisex" test battery arc designed so that all items 
areoguallv appropriate for males and females. 

PAYi:s IS administered orallv to small groups in an informal manner. Students mark 
their answers directU in a test booklet. The measures are scored UK-ally, using scoring 
directions provided, so thai couns-fors can get quick score results. 

StAu. <u l>vHnPMhN,: PAYi:S ,s based on a series of research and test-uevclopmem 
studies, undertaken bv J reeberg and his colleagues at l-ducational Testing Service 
resuliinjf in ihe-development and experimental application of the "LTSTest Battery for 
Disadvantaged \outh." described in Backer ( 1972). 

I he original test development effort, sponsored by the Department of Labor, began 
x^ith a logical analvsis concerning test format (l-reeberg. 1%8). Backer (1972) reviews 
these test. development procedures. Subsequent research included developing criteria 
for test validation (I reeberg & Reillv. 1971) and a longitudinal validation sfudy (Free- 
berg. 1974. I reeberg & Shimberg. 1976). Results from validity studies to date have 
been modeM. but available evidence does suggest that the measures may have some 
potential lor use wttHtdance work with disadvantaged youth. 

At the present time, a revised version of a user's guide for PAYES is being prepared 
as IS a technical manual that will provide a fairly comprehensive discussion of the 
rationale for the test constructs and their design. This manual also will summarize 
results obtained in the validitv studies mentioned above. Four of the seven measures 
(job knowledge, lob hoiding skills, job-seeking skills and self-confidence) are curremly 
in use nationwide b> the L'.S. Department of Labor for program evaluation purposes 
vMth longitudinallv obtained samples of youth program enrollees. The evaluations 
include collection ot posi program outcome data and. thus, provide an opportunity to 
develop larger scale norms and to look at predictive validities for the four measures. 
I'pdated validity intorniation will be fed into subsequent revisions of the technical 
inaiuial 

Ami( M-os: In the user\ guide for PAYLS. it is explicitly stated that the battery 
should not be used lo determine program participation, nor is it to be thought of as a 
substitute toi counseling but rather as a supplement to it. The PAYES guidance battery 
IS seen bv its developers as a tool that deals with aspects of basic employment training 
cons.deied es>ential in more vivational and work training programs. Further validity 
data will be needed in order to establish that PAYES can have a significant impact on 
guidanct. decisions 

•V . 1 ss Ihe test Kitierv. administrator's manual and user's guide are available from 
I ambndge Book C onipanv , New York. 



luu t)i- 1 1 SI Self Interview ( heck List (SK I.) 

Dhs, kUMius \ocatioiMl interest checklist for use in the (. leff Job Man Matching 
Svsicni 

/7 
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Format: l»xammees complete this checklist without supervision, indicating behavioral 
units of work (coiKeptualized along the dimensions *'things, people and ideas*') they 
like best and dislike most; then they indicate those the> have done most and those they 
have done least The checklist is scored to produce two applicant profiles: one describes 
activities preference, the other activities experience, arranged according to 16 dimen- 
sions of work. Results can then be compared with data on the characteristics of the 
jobs, organized along the same basic dimensions. 

SiA(ih Oh DhvuopMhNi: Initial development of the Job ^ Man Matching System and 
the SIC'I are described in Cleft & Hecht (1971). Conceptual underpinnings of this sys- 
tem, and Its application in a number of settings, are given in Cleff (1977), The latter 
publication includes details on several validation studies that have been completed 
using the Job ' Man Matching System. Reliability data also are provided. Information 
is given on an operauonal svstem fen the Cleff Job /Man Matching process thai 
includes computer analysis and profiling of results, based both on information gath- 
ered about applicants from the SICl and information collected about jobs. Uses of 
this approach, with a number of adaptations as required for local circumstances and 
different types of clients, are given for an employm^'nt and training agency (City of 
Cincinnati), private industry, and an adaptation by PREP, Inc. (see description of 
COATS, below). \ separate validation study of the Job /Man Matching System 
(Nathanson, 1975) also is described, 

APHiiCAnos: The Cleff Job Man Matching System (CJMS), and the Self Interview 
Check I ist {SlCl ), which is the basic instrument for gathering client data, have 
received sufficient research attention to be ready for operational use in employment 
and training settings. The reader is referred to the description below of CO.MS for 
what is perhaps the best -developed application of this approach, 

.\('( tss: Available from Dr. Samuel Cleff at the Center for Human Technology, 
Princeton, New Jersey 

• • • 

Tiri> Oh Ihsi: Tolcriincc for Burraueralic Sim ture Seale (TBS) 

IHscRiPiios: (questionnaire intended to measure extent to which an individual has a 
preference for jobs tvpical of large bureaucratic organizations (i.e., highly structured 
jobs) 

FoRMAi: The Tolerance for Bureaucratic Structure (TBS) Scale was developed as part 
of a study designed to create conceptual and operational tools for achieving a more 
accurate match of persons to jobs. The TBS Scale is a self-report questionnaire with 
43 Items written m simple Fnglish. Sample items are, 'M would like to have a job where 
I could set the hours*' or **If everybody obeyed the rules at work, there would be fewer 
accidents.*' Fach item is rated on a four-point scale (strongly disagree-strongly agree), 

SxMih Oh DtvuoPMhsr: In some preliminary validity studies, significant, although 
modest, correlations were obtained between bank employees* TBS scores and ratings 
by supervisors Si^me further validity data from employment and training applications 
of the TBS S^.ale are contained in a test manual available from the instrument pub- 
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'I;'; -"^^^ P'^-'^^^^ .nturmaiun, on .cs, adnunistrat.on and normative 
and K-;.ah,l,i> data ( .cncral ha.kgroi.nd on the I BS Scale and the concepts underlying 
II are conlained in Haket ei a! < N"'4). i>»^i>yiuii 

wlu'! s".l rtr" ^^'^^•'^'P'"^'"'- I^"^'^ance tor Bureaucratic 

SI uuur. S^ale s prohahlv not tead> tor operational use m emplovmem and tramin« 

lool. especiallv .,ih respect to ,oh opportunities requiring a person to adjust to a high 
degree ol structure and hureaiKratic regulation. ^ 

Ai I » sn: Available from the ( enter tor J>olic> Research. New York 

• • • 

1 1 1 1 1 Of I jM . Unnn RatiiiK Si'ales 

ichiev7meni '''''' sdt-perception. locus o» control and need for 

loKsui: The Iseng Rating Scales uer. developed in three related studies designed to 
.nvest.gate relationships between work-related characteristics of vocational rehabilita- 
tion trainc-c-s and personalitv variables, l ocus of control was measured in Tseng (1970) 
sZ ';;;'^^"f'> ^-'^-^ need for achievement was measured in 

cng W7^„ J,, ach.evemeru scale of the t.dwards Personal Preference Schedule; 
and sell .pc-rception ,n Tseng ( W-b) using a rating scale devised by the investigator. 
S.M.f ot DfVHoHMPM l-ach of these studies related scores on the te.st instrument 
elMhl , r proficiency, employability and training satisfaction of 

r hah l.ta.ion clients. Some efforts were made to adjust for low reading levels or lack 
ot ICS experience bv participating research subjects (e.g.. via individualized testing ses- 
sions), but the researcher acknowledges that these measures have relatively little to rec- 
ommeiKi them tor use with seriously disadvantaged individuals. Correlations between 
list sci)res and pertormance criteria are quite modest. 

APpi u M,oN Both because of limitations in use of these instruments with the severely 
d.sadv-antaged. and because the results obtained by Tseng are quite modest, these scales 
probabiv can serve onlv as a source of ideas for application in employment and train- 
nii2 settings 

V. tss \v.„lahIctroMi\l.S jscngat West Virginia I niversitv 

• • • 

Iiiuof hM \i>cii(ionjil Opinion Index! vol) 

Df s. RUM.uN Short paper .and-pencil instrument used to measure iob readiness 

I oRMx, the vol consists ot ss items which can be answered in about 20 minutes It 

can be administered euher in group settings or individually. Anvone who can read 

Higlish or Spanish at ihe ntth-grade level should be able to respond meaningfully to all 
h. questions I here are iwo forms (l orms A and H) of the V()| available in both 

I ngl.h and Spanish I here are also A and B tornis which can be used for follow J 

oiue (he person has left a iraining program. 
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Because of ihc complex Ci>mpuier scoring required b> the VOl, Associates for 
Research in Behavior, the test pubhsher, has established a scoruig service. C oinpleied 
vols mailed to Associates tor Research in Behavior will he scored and a diagnosis 
report will be mailed back vMiInn 10 davs. l-ach respondent's answers are added U) the 
data base so that diagnoses prov ided use the most up to date data available. 

StAta Oh Di vnoPMiNi: I he VOI is the product of a series ot research studies con- 
ducted b> the AssvKiates lor Research in Behavior (Wolt. Jackson & Mnegold, 1971; 
Benson & Whittmgton. 197^; Benson & Whittington. 1974). 

The vol deiei mines an individual's job readiness bv assessing three psychological 
dunensions: 

♦ Attractions lo work 

♦ 1 osses assiKiated with obtaining and maintaining a job 

♦ Barriers to emplovment 

f or those individuals who score low on job readiness, the VOI also presides a diag- 
nosis of reasons contributing to the individual's classification as a potential non- 
worker. This diagnosis can be used to develop a remedial prescription to help an itidi- 
vidual develop a more work-relevant posture and altitude. 

The VOI was designed, tested and normed specifically for a disadvantaged popula- 
tion. Norms are based on the responses of over 2.(XK) males and females from 13 
MDI.A centers across the countrv. The normative sample was comparable to the 
national Ml) I A population with respect to age, se.x. race/culture and education. 

Appucauos: .Although the validity data on the VOI are still quite modest, it may have 
some operational utilitv m certain employment and training settings. 



.Vci ss: .\\ailahle from the .\ssiKiates for Research in Behavior, Inc.. 34th & Market 
Streets. Philadelphia. PA 19UU 



1 1 in ()( hsi; Work Kelevgnt Attitudes Inventory (WKAI) 

DiscRipiios: Instrument for use in evaluating the effectiveness of employment and 
training programs 

loRMAi: I he NV R.M grew out of a larger research program concerned with the effec- 
tiveness of selected NVC programs (Walther. 1970). The test consists of 26 items 
arranged into three scales: optimism, self-confidence and unsociaU/ed attitudes. 

S!Au^ tu l)^v^(>PM^M: N\alther (197.S) reports the use of the WRAI in two longitudi- 
nal studies: (a) a studv of out i^f-schiuM Neighborhood Youth Corps (NYC) programs 
in tour cities mvoKing 502 subjects and in which the WRAI was administered three 
times; and (b) a studv of the second demonstration of a New hducati(^nal Program 
(Nl P-2) m five emplovment and training programs involving 526 subjects. Results 
indicate that the WRAI was able to ditferentiate between subjects making a ''good" 
and a "poor'' adjustment to work, that the change in WRAI scores while participating 
m the NVC program was in a positive direction for subjects making a '*good" adjust- 
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mem to work, and negative tor subjects making a "poor" adjustment Further infor- 

ZZZ r ''"^ • •^'-^>- Th-uth" 'vds that 

trie >\ RAl .an be used both as a measure of program effectiveness in manpower service 
dd.very systen.s and as a help in diagnosing the needs of new program participants 

trdtion ot the W R Al tor use as a diagnostic tool as well as an assist to counseling. 

the author. Dr. Regis \\alther. at CJeorge Washington University. Washington. U.C. 

WORK SAMPLK SYSTEMS 

Background. Work sample approaches for assessing job-relevant characteris- 
tics ot severely di.sadvantaged people have received much attention in the last 
few years Developments have been reported in the popular press (newspapers. 

bfiTv /"'iTr^fdr^"''-^' "^""'^ '^'"P'" '^"^h as those developed 

II. ' "^ny ^>Ars are now being used by employment and training 

agencies across the country. 

The work sample technique has been traced back to the beginning of this 
century. Hugo Munsterberg built a model streetcar to use in selecting streetcar 
operators n 1910 (Hoffman. 1969). After World War U, the PortviUez school 
in Belgium evaluated the potential of disabled soldiers for trade training by 
having them briefly try out activities in the available trade classes. In rehabili- 
tation of the physically or mentally handicapped, pioneer development efforts 
at the Institute tor the Crippled and Di.sabled (ICD) extend back to the 1930s. 

At It u. staff members first used standardized tests as part of rehabilitation 
coutiseling about 1930. They discovered that most physically or mentally 
handicapped people performed poorly on these tests and often were errone- 
ously deemed unemployable. Such aptitude tests usually en.phasized speed 
accuracy and types of life experience that were neither within the sphere of 
competence of the handicapped nor particularly relevant to the types of jobs 
that they might actually hold. ICD thus began developing work samples as an 
alternative means of evaluating the vocational potential and rehabilitation 
needs ot its clients. 

In principle, all work samples represent activities or components of activities 
abstracted from actual job tasks. Many work samples are highly similar to real 
job tasks and simply substitute job production tools and materials for paper- 
and-pencil tests or special test apparatus. Thus, for example, a work sample 
designed to appraise manual dexterity for a production-line assembly job 
might require that the examinee assemble nuts and bolts or electrical compo- 
nents in a certain sequence, tven though materials and pro-cdures may not be 
idenrual to what the examinee would be doing were he placed on an actual fac- 
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tor> asscmbh the work sample nevertheless is tar closer to the realiiy of 
vvoik ilian a papet and peticil test intended to measure the same ability. 

Some other uork >aniple svstems deseribeU here uiili/e a ditTereni approach: 
although measuiemeni ba.ed on observing behavior as in the above dcserip- 
tion» the tasks required in the sample may actually be ahstravteil froin real job 
tasks, so that the samples do not especially resemble the jobs for which they 
are measuring traits. Although work sample systems of* this sort have lower 
**tace validitv" (that is. resemblance to real jobs which, among other things, 
CiUi increase client acceptance of and motivation for assessment), they can per- 
mit tneasurement thai is more clearly related to whole groups of jobs and job 
skjIK. such as those in the DOI.^ 

I he devcK^pmeni of standardized work samples for use in appraising work- 
relevant characteristics is basicalK the same regardless of the job types or the 
client population of interest. Occupational areas are selected, particular jobs 
analv/cd in order to ideniifv their functional componenis, and work sample 
tasks devised that will represent some or all of these activities. Fhe job analysis 
Itself niav be performed through questionnaires sent to employers, interviews 
with supervisors or actual observation of the job-in-process. Development of 
normative, reliability and validity data then can proceed as for any other 
assessment lechiiiquc. 

Much has happened m the field of work sample systems since the early 
cttortN mentioned above. Since the author's 1972 discussion on this subject, 
theio luiN been a ctMiMdcrahle proliferation of commercial development in this 
field. Hcic. a of l.^ svstems are described, following the sanic capsule for- 
mal as Used tiM the papei -and-pencil instruments. Included are •\)ld'tiniers" 
nUlIi as low \ R and J. I- A S. phis newcomers such as COAIS (which actually 
mcludcN ciMiiponeiits otlici than work samples in its system) now beini: very 
hcaviU puMiiotcd foi use m empkn nieni and training agencies. 

• • • 

1 1 1 n Of s N n M ( omprehensi%e OccupuUunul Assessment »nd 
IrtiininK system i( OMS) 

Dim hum ins MulticiMnpiMuTt! a>NCNsnicnt sssioin incasurin^^ living: skilN. cniplovabil- 
uv aiiihiJcN. vvoik peifi^rinaiKe c.ipahihlv . and job matching 

loKMM Ihcrc .lie iiHiJ h.iMc vonipiMiciUs to C'O.MS: loh matching, cmplovability 
attuiulcN. vviw k sanipk'N .ukI NkilK. I ho 10 work samples arc each packaged sep- 

araieU in a piwiahie viMUainei Inc . (he developer ofC'OAIS, eMunaies that it 

tequtfON Horn 2s \o fx) funiis \o ciHtijWeie tfic entire prtve^s. AdmimMration is audio- 
vjsaal in iiMmai anJ. es^ept \o{ the Wi)ik sample Ciiniponciii which does rcquue an 

•} .»f .1 :;n.:.w'. .'T ;Ik- iM.^N .itij .imin .»i tills appfiMvh. scc ihc papciN h\ Duun, \adi»l^k\ and 
\K I >.ni et u \K l).inrv i 1 1'^ * ' i 
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cvaliKitoi. the evaluation pr.v,cdutcs can proceed either u,th an mdcpet.dcnt evaluator 
ot with the Jictit alone Scoruij! is ;>eitotmed b> computet ...t l>RM». hic 

( ()-\ls wasonjiinallv JoMgned lot Use in emplo>itient and training agenoics and in 
se.omlaiv education .u, dance programs. Separate loose-leal iimni.als ate provided lor 
ea.h component I hese manuals contain details tegardint; administration, inierpreta- 
t>on ol lesults and suggestions tor vvorking vvith clients on each component, as ucll as a 
sumniaiv ot the research studies and developmental methodology used lor each com- 
poneni A sepaiatc manual also is piovided tor each work sample. 

\ oimat ol the svsiem's tour principal components ,^ as toiUms: 

I Job Mau-hinK \>Mem I hi component matches the person with job and training 
^M>po.iun,i,es I he svsteni ,s based on the degree to which workers approach or 
..void Ih specihc ski-l categories. I he dient uses the program to identify his own 
preleiences. experiences and capabilities in three stages; 

a \ss,'sum-nf | ,i,ecn audiovisual cartridges present photographs and drawings 
depicting activmes trom e.,ch ot the skill categories, f ive cartridges deal with 
workei pietereiices. tue with experience and live wiih capabilities. 

b ru:. npn„n Hie client uses the information gained during the assessment 
phase to plan and pettotm activmes designed to help him learn about himself 
.md loh lequiteinents I hese activ i„es are contained in a Sliukw Handbook. 

c i uiluut„.n I he clieiii carries out the previously planned exercises and plots his 

PIOglCSN 

Mnplo>abilii> Alli.udes s>Mem • In this component, the client determines what his 
•itiitudes and beliavioi s are and compares them with the attitudes that employers see 
.IS beiiij: uiipoitan. toi the lining, pionioting. or firing of an employee. Thirteen 
iob scekmg attitudes .,nd 2.^ lob-keeping and job-advancing categories are used 
auMiii wuh three stages. 

a MX .uKl.ovisual caitridges containing what the developer calls 25 

"le.il lite" adventures .ire used. 

h /v..^.r,/.,„.,, I xeroses ,„ the Sttuhw Handbook help the client interpret the 

u-siiliN and cotiipate his lesiilis with emplover data. 
. / ^auuttion Clients keep track ol their attitude development bv charting their 

.udv.iies oil I earning Activiu Maps. Crneria for successful completion of the 

.ui- .iiics .lie jiuoii 

Uork samples s>s,em I'lese.itiv the ( -O.M S contains 10 work samples that wore 
.lo-.cU>ped on the basis o\ content analvsis ol tasks common to lob families- Draft- 
ui.'. I leiK.il oiiKc. \leial C oiisiruction; Sales; Wood Construction; f-ood Prepa- 
'.it.o.i. Medual se.vue.. Services; Harbering-C osmetology ; and Small 

\ iiL-iMc 1 he xame inu-c sMl-i-s are involved in the svstem; 

.. InsiiiKMors .„e contained in audiovisual cartridges. Kach work 

sample .oiiiaui. o.^upaiional inlornuition which is „sed to elicit the degree of 
viKii! niic.c.t ,n ihe woik sample. I he insiructions are given in a siep-b^-siep 
iiiaiiiKT .iiid ihe.aiifKkesu.psvvhcna task is to be performed. 
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b. Presirtption —Wi^r computer scoring, the client uses a Uludent Handbook to 
inierprel his results 

c. tyalualion — \\\t: client further investigates jobs related to preferred work sam- 
ples and pet forms additional job -related tasks that were not included in the uork 
sample. 

4, tiving SkilK S^nlem— I he component deals with what skills are needed to be tunc- 
lionalU hterate m contemporary swiety. The program classifies literacy into skills 
(reading, writing, computation, problem solving, and speaking-listening) and 
knowledge areas (consumer economics, occupational knowledge, <'ommunity 
resources, health, and government-law), and has three phases: 

a. /U.vfvvmt'«/ -Six cartridges containing 18 •'advemuies" are used to evaluate lit- 
eracv skills and knowledge areas. 

b. Prewnpnon - ~ The skills and knowledge areas are reported to Ihc client in a 5 x 5 
matrix. Weak areas arc identified using a Student Handbook, 

c. /:'v(//w(///()^/ — Individualized objectives are established and the client works 
toward raising his litcracv leveU where necessary. 

SrAcit Di vMopMi-M: I och ( W77) describes the initial impetus for development of 
the COAIS system as PRl'P, Inc/s awareness that no comprehensive system existed 
that could provide assessment information across the areas the system now repre.sents. 
C'OAI S incorporates C'leffN job man matching system, the Adult Performance Level 
(API.) measure of functional .literacy, and data on work sampling developed by 
Project C'ARhbR. The orientation of COATS' developers from the beginning was to 
make the best use of what v^as already know n in the area of vocational assessment and 
to employ an audiovisual format wherever possible. Details of the development of 
<.X).\rS is available in I och (1^77) and in several research reports published by PREP, 
Inc. 

i'Aaluaiion of the C'OAFS svstem thus far has been relatively informal, mostly clini- 
cal estimates of the utility of the system by users. Selected components of the COATS 
system, such as the Cleff job man matching system, have been subjected to more 
extensive evaluation (see description of Cleff system above). 

Ahhiu AMos: The CO .MS assessment system has been carefully designed with atten- 
tion to <he best of what is known about client assessment. Is specifically intended for 
employment and training populations and makes good use of audiovisual materials 
that may be more appealing to the severely disadvantaged than traditional paper-and- 
pencil testing. It is probably the most complete approach to client assessment now 
commerciallv available but is also of potential value in that each of its main four- 
system components can be used independently. Indeed, the writer has evidence from a 
number of uKal employment arid training agencies that independent units of COATS 
arc now being mcorporated mto assessment programs, and it is suggested that any 
agency considering the implementation of COATS determine first whetiier the entire 
system is required, or only part of it, PRHP, inc. provides computer processing of 
assessment results and training in the use of the system for a fee. 
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One imponant caution is that, despite high face validity, the entire CX)ATS system 
has not yet been evaluated, so its overall ettectiveness remains speculative. 

At t i-ss: Available Irom PRI P. Inc , Irenton, NJ 



I iii.F Of S>su m: HtsUr ^valuation S>Mem 

IH-.Si RiiMios: Baiierv ot psychological tests used to measure vocational potential 

J'oHM^r: The Hester I valuation System is a series o! 28 psychological tests, grouped 
into seven factors and based on the Diclionarv of ikxupationul Titles analysis of 
v^orker trails required for dif ferent kinds of jobs. I he systemN developers suggest that 
about five hours is required to complete all of thc testing. The client completes 28 
paper -and-pencil tests, after which computer ;iCoring is available through Chicago 
Cioodwill Industries. 

I he score groups are as follow s: unitaterat motor atnfiry, bitateral motor ability, 
perceptual -motor coordination, intelligence, achievement and physical strength, A 
number of standard psychological tests are used as part of this battery, and most do 
not require reading abilities since they are not verbally oriented tests. Once testing is 
complete Uncluding interview input on the clientN orientation towards people activities 
at work), data are input to the computer, and a report is returned to the counselor. This 
report includes a printout ot worker trait groups identified as likely matches, based on 
information supplied about the client, and a selected list of job titles together with their 
physical limitations, working conditions, CiHD, etc. 

Rehabilitv and validitv data are available in the Hester manual, although the amount 
of validity evidence presented directly is very limited, 

S;m.i oi- Dkvkopvum: Cieneral information about the Hester Evaluation System i.s 
available in lay lor ( 1977). 

Appiicaiion: I he Hester I vahiation System provides considerable information 
regarding clients' psychophysiological and perceptual-motor characteristics. The ex- 
tent to which this information would be directly useful in employment and training set- 
imgs. even gtven the (ioodwiH computer report printout of worker trait groups and 
specific lobs. would depend upon what kinds of clients and potential services were 
included. \lso of concern is the lack of validity data on the system, although some of 
the individual tests within it are well-validated psychological instrumeiUs. 

Access: Available froniCioodw ill Industries of Chicago, II. 



Ii tn Of S> su m: Jenish Fmployment and Vocgtional Service (J.KA.S.) Work Sample 
System 

UvsK RUM ion: »>ackage ot :s work samples designed primarily for use in vocational 
assessment ot disadvantaged and physically disabled people 

l oRs^Ai : The J l V S. System was originally developed for disadvantaged populanons. 
The svsiem is organi/ed around ihe worker trait group arrangements found in the Die- 
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itonarv oi (hi uputfonul hfles, I he 2S \^ork sarnpU's that constitute the system repre- 
sent 10 ot these s^orker trail irioiips: (I) handhng; (2) sorting, inspecting and measur- 
ing; {h lending; (4) nianipulatitig. {^] rontuie checknig and recording; (6) classifying 
and lihng; C) uispeviiiig and si.vk Juvking; (8) ciallsinaiishii^; costuming, tailor- 
uig and dressmaking; atid (iO) draltiiig. Uie samples are intended to be administered 
progiessi\cl\ uiiti the cheni siartuiii wiih the simplest work sample and proceeding in 
order ihfouuh the svsiom to the moxt complex, I he v\otk samples are administered in 
an eMMronment which resonihles a real work situation as closeK as possible. Contact 
with rheevaiuaior is immini/ed m rhat leedback on performance and behavior occurs 
at ilic end o\ rhe evaluariori [>ro\,ess. 

•\n e\a!naior*s handboi>k is Nup[>lied wirti rhe sssrcm Ir conraiiis detailv regarding 
la\oui. admiiiistration and scorinuiW the wvm k samples. Most insrrucrions are oral and 
demonsrrared. W ritren msrrikrions are used onl\ when re» Jing is a typical requirement 
in the wor ker rrair urouf^ bcmu sampled 

Data uenerared bv rhe I I A S. Svsreni include obserNarions made by rhe evaluator 
on chenrs as the\ [>rogress through rhe Wi>rk samples. I hese svstemaric observations 
are made on a list ot Jearlv deliiied work relared behaviors and performance factors. 
Observations aie made ou rhe work sample record sheers provided with the sysrem. At 
the end of each dav\ work, these observations are summarized on daily observarion 
sheers. I mallv. intormarion iroin rhe work sample record sheers and daily observation 
sheets issummaii/ed into a imal leporr lorm. Ihe final reporr form contains informa- 
tion about theclient\ mterests, aptitudesand work behaviois. 

hnie spent on eaJi work sample is recorded on clienr record sheers. In addirion. cli- 
ent oiiipul is clK\ked \o\ etiois Ihe evahiaror\ handbook defines whar consrirures 
errors roi caJi ol rhe vvork samples hmc rn minures and number of errors is con- 
verted to rhree pomr ratine scales usmc the client norms. 

I he latest revision and expansion ol the .1.1 . VS. Svsrem norms rabies was published 
m I'^rh Data were eaiheied i»n \ .0'*2 persons Irom M taciliries rhroui^hour rhel'nired 
Mares Overall noinis and diUercnrial norms tor se\ and rvpeol facilirv (Vocarional 
KehabiliraruMK I mpKumem and Iiamniii. (ioodv^ill. School and Memallv Retarded 
School I are now available • 

Purchasers ol the I I \*.S. Svsteni rmisr biiv rhe whole sysrem. Individual work sam- 
ples ate nor supplied Ihe svsrem issoldvMilv ro tacilines willing ro send an evaluaror to 
Philadelplua tor a one week rraimnu prv^giaiiK Included in rhe price of the svsrem is an 
on sire iiaimng vimi made hv a I I V.S. vocational consultant. During this visit, the 
entire lacilitv\ stall is orierned ro rhe work sample svsrem and is assisred in rhe setting 
upo! an ellecrive evaluanon urur. In addition, relerrmg personnel are raught how to 
best utili/e work sam[Me results 

SiM,t Ol DivMopvnsi Ihe lewixh Iniplovnient and Vocational Service of Philadel- 
phia hrsi developed work samples ai us Work Adjusrmeni Center, a vocational reha- 
biiiiation taciliiv Ihrouuh the l^^Os and the earlv l%()s. Work Adjustment Center 
personnel developed appro\iniarelv 150 work samples lor use wirh rheclienrs served b\ 
their work adiusrnienf procram. I hese wv>rk samples formed rhe basis of whar was 
lata tohevomeihe I I \ s Work Sample Svsrem. I he rranslormarion of these samples 
into Ihe 1 I \ s. Sv stem was acciMiiplished w irh the support of the U.S. Department of 
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1 abor Afler the relationship bet^.een J.l-.V.S. and the Department of Labor ended. 
J.f .v.s. became the sole supplier ol the s>stem lor the entire United States 

Normative, reliabilitv and valid,t> data are available f rom the publisher and also are 
reported in several rcscauh doct-rnents <.!.[• V s.. ihe test publisher reports that 

I'L'sir — throughout the 



nngs the .I.I A S. Work Sample Svstem would j.ppear to have operational capability 
for further application., although the cost o( u^ing this fairly complicated system 

s^de'red 

??.'.m'' 'Iv' ^^'^''"'^'"^l K^-x^-arch institute. Jewish Employment and 
Vocational Service. PU) Sanson, Street. I'fiiladelphia. I'A 19103 

• • • 

run o^ S.sihM; Met arron-Dial Uork tAalualiun Sysiem 

Dksi rii'iion: Seventeen work samples designed to measure neuropsychological func- 
tioning of thementallv retarded and mentally ill 

loRMAi: The Mcfarron-Dial sv.tcm contains 17 separate instrumems- grouped into 
five factors: 

1. ierhul o...'m/„v-VVechsler Adult Intelligence Scale (or Stanford-Binet Intelligence 
Scale) and the f'eabodv Picture Vocabulary Test 

2. .Smv«»rv - Bender Visual Motor Clesialt lest and Haptdic Visual Discrimination Test 
.V \toit>r ahi/ities — 

a. I ine Motor Skills Assessment: beads and box; beads on rods; finger tapping- 
nuts and bolts tasks; rod slide 

b. tiross Motor Skills Assessment: hand strength; finger-nose finger movement; 
lumping; heel-tiH- tandem walk; standing on one foot 

4. /:w<>n(>w/-observational emotional inventory 

5. //f/fijrum»«- coping. San I rancisco Vocational C ompetency Scale and Dial Behav- 
ioral Rating Scale 

I he tests, tasks and scales (which include both commercially available instruments 
and some developed espcciall.v for this system) are grouped according to the five fac- 
tors. I he VNAIS and the Stanford Binel must be purchased from their appropriate pub- 
hshers; all other necessary materials are packaged by the McCarron-Dial publisher A 
bound Offset manual contains all system details lor administration, scoring and imer- 
pretation 

Ihe evaluation pnxess begins with a client interview and then proceeds with admin- 
istration of each of the test compi>nents. Completion of assessment factors 4 and 5 
typicallv requires a fx-riod of placement in a work setting, most commonly a sheltered 
workshop The first three factors can be assessed in one day; two weeks of systematic 
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observation in a vvork setting arc needed to assess the emotional and inlej?ralion-cop- 
ing tactors. Administration, sconng, norms, formal tor reporting and so forth arc pro- 
vided in ihe system manual 

SwitV in DhvMopMi SI. Ihe McC arron-Dial is designed \ot the purpose of assessing 
the nientallv disabled jx»rson*s abilitv to function. It uses a eonibinalion of widely 
accepted, individuallv admimsteied psvchological tests, assessments of fine and gross 
motor abiliiv and an extended period ol observation. No reliability or validity data "arc 
currentlv available. 

.AinM UMios: I xcepl tor emplovment and training agencies that might have a sjgnifi- 
cant popiilanon ot mentallv retarded clients, the McC arron-Dial would seem to have 
limited application although it could be a source of ideas. 

.•\((iss: Available from Commercial Marketing iMilerprises. 113(K) North Central, 
Suite 11)^ Dallas. I \ "5231 



Inn i>K S^sihm: Mkro-I()\%KR 

Di scRipiios: Batterv of \ } standardized work samples for assessing vocational apti- 
tudes ot rehabilitation clients 

l-oRM.<i: I he 1 } work samples m Micro-rOWl-.R are divided into five general aptitude 
groups I our ot the samples have alternate forms to prevent copying during adminis- 
tration and tor possible use m retesting. Work samples are provided in the motor, 
spatial. clericaL perception, numerical and verbal areas. All work samples are repre- 
sentative of actual work tasks tliat individuals being assessed might be called upon to 
perform in a |ob (e.g . taking telephone messages). This system is designed tor group 
administration; required instructions to clients are recorded on cassette tapes. Total 
testing lime is about 15 hours. Details on scoring and requirements for training of 
vocational evaluators are provided in manuals included with the system. A variety of 
Hcoring and reporting forms also have been constructed for use with this system, 

SiAi.i Of DivfUipviiNi: The Micro-IOWIIR system is aimed primarily at a general 
rehabilitation population, but the publisher asserts it can also be used with special edu- 
cation students, the disadvantaged and adult offenders. The work sample techniques 
have been designed to measure aptitudes defined and used in the Pu tmnary of (hrupa- 
uonal litli's I he results »re related to the aptitude requirements for entry-level jobs in 
specific worker trait groups defined by DOT A variety of normative data bases are 
available, and the technical manual for the system includes some evidence on reliability 
and validitv Accoiding to Backman (1^77), predictive validity studies are still under 
wa> . and results will be shared with users when these are available. 

Ai'Piu xtioN. Micro lOWl R would seem to have some potential for direct application 
in emplovment and training settings and mav have advantages over some other work 
sample systems because ot its relative brevity and because it can be administered to 
groups lather than )ust individual clients. 



.Ac I i ss Available from K'D Rehabilitation and Research C enter. New York. NY 
2S 





run u^ s\Mj m: SsMtm ^pprovch to ViK'tilioniil t:\aluittion (SAVI-:) 

I)»M KiMios: Ori-ani/int- trainc«ork lor work sample i>pc vocational evaluation of 
UiNaUNaniaK'eU and dtsablcd service recipients. 

I«.R\1M- Ihe SAVl- package consists of a compact manual with simple. -.(ep-bv-Mep 
iiiMriKiions and a Mippiv ot tv)rms needed for vocational evaluation in reference to 47 
woikor Iran groups trom the Du iionurv of (hrupommul litles. 

Included in the packajie are evaluator instructions, sample figures for easy use of 
tonus, vvoi k sample operation sheets and equipment lists, norms and validity informa- 
tion and DO I letercnce material. Ihe kit includes suggested requirements for setting 
up vvo.k samples to esaluate each o\ the DOT areas required for a given assessment 
ottori Ihe test publisher suggests thai most needed materials will already appear in 
schools, esaluation facilities or industrial arts classes. Administration of the full 
sNstein re,,uires ..bout 14 hours, and adequate training generally is afforded by 
carctui leaumg ot the materials in the SAVI-. package. 

Siv.-.f t.i DiviK.PM.si: IheSWl package was developed primarily to provide a rela- 
tives LMsv and mexpensiso svav to obtain vocational evaluation information organized 
.iccoidiii)! to the schemas within the Dudonury oj (hrupalional Titles The .SAVK 
appro.ich IS unique in that commercially available work .amples can be substituted for 
tiMiiv ot Its components, and. thus. SAVF can be used as a framework for setting up a 
vocatKMial evaluation work sample system in a variety of formats. .Some limited data 
on icliabihtv and validitv are presented in Cobb (1977). 

•Xn-iK viios: Ihe SWl approach to vocational evaluation is relatively inespensivc 
and niav have some applicahilitv to employment and training agencv settings in terms 
ot plaiinine and organizing a work sample-type assessment system. Evidence available 
tor this report was too sketchv to indicate whether the system can be used as more than 
a source ol ideas and planning tools. 

•V < I ss; Xvailahle trom S \VI- I nterprises. P.O. Box 5871. Rome. GA 30161 

• • • 

1 1 1 II t >» S\ s n M singer \ ocational F^iiiuation System 

Dis, KUMics. Svstem containing some 26 work samples presented in an audiovisual 
lot mat 

I oRvui \i present, the lo!lowin>: work samples are contained in the svstem: sample 
making, trench .l^^cn,h!v . drafting, electrical wiring, plumbing and pipefitting. carpen- 
tiv. refrigeration heating air conditioning, soldering welding. office and sales clerk, 
needle tr.idcs. nusoniv. sheet metal, cooking and baking, engine service, medical ser- 
vice, cosmetoiogv. data calculation and recording, soil testing, photo lab technician 
and production machine operating. l ach work sample is self-contained in a carrel and 
instruct lonv arc given using an .tudiocassette tape atid film strip format, with the client 
controlling the r.ite of advancement. I liis programmed material is occasionally supple- 
menu'd with wiitieii material. If .ill 20 work samples are given, approximately three 
weeks m.i\ he required for the total assessment process. .Administration and scoring 
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iMtotinaiion aic presided in a printed manual bound in a loo>c lcar r'oldcr. Standard- 
i/ed forniN aie included tor pcrloimancc and interest rating and for sumniari/iiig 
re>ullN. 

S\M,h i)V lh\\nn*\us\ I he Smj^er <onipanv\ in\oKenient with the rehabihiation 
and enipUnnient and irammn t»i-'l*J^ began when it won a contract in 1965 to operate a 
lob Corps center. Since theti. a diMsion of Singer has become one ot the leading pri- 
\atc operators or Job < orps centers in the nation. I he s>steni is based in part on 
I'OWl-R (described later m this >cclion). and since its initial introduction in late 1971 
has been adopted b\ appro\imatel\ 1 .(XK) agencies, schools and institutions. The sys- 
icniN approach is predicated upon a conibuialion of subject self evaluation and e\alu- 
alor observation ot task-related behavior and emphasizes self-motivated learning 
ihiough permitting the evaluee a great deal of latitude in terms of pacing and the possj- 
bilitv of repealing cerlair. Namples in the total procesMf necessary. 

The svsiem is intended pnmarilv for special-needs populations (e.g.. disadvantaged, 
piildlv tetaided. phvsicallv handicapped, correctional), but may be used ^viih non- 
special groups as well. Since it relies on an audiovisual mode of instruction, it has spe- 
cial potential tor use with populations h iving limued reading skills and or prior aver- 
sive experience (or little experience) with paper -and-pencil rests. Ciannaway (1977) 
overviews the svsiem and givcj^ informarion about iheavailability of norms. Ciannaway 
also reporrs MMue initial rehabilitv data but comments that no predictive validity stud- 
ies on the sv .teni have as vet been published. Informal evidence from actual use of the 
svsiem and a validitv studv that was completed but not published at the limeof Cianna- 
wav \ publication are mentioned in the Ciannawav paper. Ciannaway also reports rhat a 
signiltcani reviMon ot the svstem is currentiv under wav. This will incorporate a num- 
ber o\ technological advances as well as improvements based on field experience with 
the svsiem. 

Appin viios: Ihe Singer Vocational I valuation Svstcm would appear to have signifi- 
cant poicniial ivM apphcaiioii witlnn an employment and training agency setting. The 
SvNiL-m iN well supported b\ the tesources for training and eonsultalioii of a large com- 
meici il enierpiiNe. and ifie audioMsual format seems particularly well suited for per- 
sons with Imiiied reading skills and poor prior experiences with paper-aiid-peiicil tests. 
Howevei. beiiei deusioiis about the svstem can be made after more validitv data are 
available 

V( isN Singer I ducaf.on Dimmoil C areet Sssteius. SO C ommerce Drive. Rochester 
NV 146: ^ 

e • • 

Inn snniim lulent Vssessment ProKrain ( lAP) 

Dim HUMUis iiaiterv o\ perceptual and dexteiiiv tests 

h>KM\i. Meven tests ate iiKluded m the svsieni: situctural and mechanical visuali/a- 
tion. diNcriiiimaiion hv si/e and shape, discrimiiiatioii bv color, tactile discrimination, 
line diNcnnnnaiion withsUii tools, gross dexieritv with tools, circuital v isuali/atioii. 
feieiuion siiuctural and mechanical detail, and structutal and mechanical v is;jali/a- 



lion iti greater depth. I he tests are packaged induidually Nvith a spiral-bound offset 
riiaiiu.ll. itK Uuling some details ,'or administration atid scoring, The last test in the bat- 
ters is tor tcMtng the limits with clients who perform extremely well on the first 10 
tasks; the deu-ioper estimates that only 10 percent of all clients' would take this final 
iiisirunu-ni Administration is on an indiMdual basis and requires two to two-and-one- 
lialt hiuirs 

Siva Hj 1)1 M luPNusi. I his svstem is designed to proMde fine details on the percep- 
tual and dexteritv tunctioning oi clients m a variety ot settings, and the developer does 
not claim that the system assesses all vocationally significant capacities and behaviors. 
In tact, the maiuial states that other assessment devices should be used in addition to 
the I AI> to obtain a complete evaluation of the client -on factors such as vocational 
inierosis. lob knowledge, and cognittse and conceptual abilities not measured even 
^iiulireclK m this haiterv. 

Norm.itue data are available tor high school student populations and for several 
special populations. Some evidence on reliability is given, but there is no data available 
on validitv ot I \l' Cieneral intormatiori about the current development of the system 
Is available 111 Nighswonger ( W"). 

M'l'iu Mius. I his batterv might he of some use for special application in employmem 
and training .igencies where the kind of information TAP provides may be useful in 
making tiainingoi placeniciit decisions. 

A» i I ss latent Assessment Programs. ^Oj.s C olby Avenue. Des Moines, lA 5031 1 



Inn ui s>snM lestinK ()rienlaliun and V^ork K*aluation in Renabilitation 
(lOUKKt 

I 

1)1 St KiiMios ( oniprehenMve work sample assessment battery designed primarily for 
■ise wiih the phvMcalU di-abled 

1 <.KMM I he low I K consists ot over 1 10 work samples in the following 14 broad 
ocaipaiioiMl cioups: clerical, dratiing. drawing, electronics assembly, jewelry manu- 
tactimng.le.tihci goods, letteiing. machine shop, mail clerk, optical mechanics, pamo- 
i-iaph cngiaving. sewing machine operating, welding, and workshop assembly (Rosen- 
beii!. 

I he loUl K sNsicni is deMgiied primanlv to estimate handicapped clients' present 
skills, le.i.mng poicniial and loh training needs. Job-ix-rformaiice factors such as 
speed. a..i)Kuv . inechanwal aptiiude. personalitv variables and attitudes are assessed. 
\tiioiu- Ilk- laiici ate work h.ibits (neatness and industriousiu-ss). success in relation- 
ships with M.peiviMMs or tellow workers, attendance and punctuality, work tolerance 
and ica.iioii lo the total work siiiiation (abilitv to adjust to the noises, temperatures, 
odo.x aiul .luiviru-s ivpuai toi iiidustiial jobs), frustration tolerance, personal groom- 
ing, .iiid peixon.il hvgicne 

1 liiix. Ill addition !o piov idiiig data about lob aptitudes and skills, the FOWFR sys- 
tem .oiiMiiiiu-x a Jinual tool that .an be used to make inferences regarding a client's 
emotional and amiiKlmai adiustnient to work, work-related habits and other personal 
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characiciislks iniporiant lo \ob suuvss A skilled csaluator can use behavioral oh -r- 
\aitiMis honi v^oik samples m niiuh the same wa\ thai a dirueian uses preterred psy. 
choloijual test instt iwneius 

AdnunisiiaihHi oi itie l(>\\l R s\stcni lakes ttoni ti\e lo seven weeks, during which 
lime ihe e\ammee is e\posal lo all work samples wiihm his oi her phvsiea! and iniellee- 
lual capaeilies. I he Insiiiuie toi rheC iippled and DisahleJ has used lOWJR lo e\alu. 
ale nuHe than 6.(HH) vn ihopedicaiU anJ emoiioiialK handicapped clienis during ihe 
past 20 \ears. Ihe hisiiiuie also has assisted oihei lehahiiiiaiion lacilnies in imple- 
meninig anJ usmij ihc lOVM K s\sicrn, prnnariK ihiough a series ol iraining sessions 
ai k l)(aiiended b\ o\ei 2^0 vocational e\alualois since 1957). 

Swu) n, Dmmopmjm: Ihe 1 OW IK is probabU ihe besi-known work sample svsiem 
m eMsiencc (Rosenheiv!. I^-'M. lOW 1. R ha*, been widelv applied in rehabiliialion sel- 
lings ludgmg trom lesinnomal e\idence. ihc !(>\V{ K s>siem seems lo have consider- 
able poieniial loi use in \ocaiional e\aluai:on ot ihe physically and menially handi- 
capped. Boih clienis and lehabiliiaiion workers speak glowingly about iheutilitv of the 
assessiiieni evpeiience ami ihe data ii gathers. However, the applicability of the system 
loMheculruialK disadvantaged has not been clear!> demonstrated. Moreover, the em- 
pineal evidence bearing upon the predictive validitv ol TOWl-R for vocational deci- 
sion making has been, at least thus far. somewhat disappointing. 

In oneot the maioi studies of U)VVI R\ practical utiliu, Rosenberg (1967a) found 
lhai U)\M R >cores were, in general, not as successful in predicting vocational success 
as were irainmg instructors* rating of clients. C orrelations between TOWLR scores 
and vocational uku uciors* ratings were low. rarely evceeding .19. Th^^e discouraging 
tmdings plus ditticuliies in iniplcmeniing the system in widely varying facilities with 
varving job markeis led Rosenberg (1967b) to conclude that **lhe true validity of 
lOWl R lemains unknown'' ip 48). These findings temper somewhat the glowing 
testimonials from rehabilitation workers and clients. 

Rosenberg (I9'''') presents an update on evidence available for the usefulness of the 
lOWl-R svsrem I litmaielv. there is insutficieni evidence as to the predictive validitv 
ol the svsreni. alrhough Rosenberg comments that ii is ditticuli to conduct research 
designed tor spec.f«c validation purposes because of the interrelationship of this type of 
vocalioiial assessmeiii with other aspects of the service-delivery process. 

•\i»nn xiioN Ihe lOVVl R svsiem is quire lengihv and c<nnple\, and it has been 
designed ptimarilv tor a rehabiliMiion population. Ir might also be applicable in cer- 
tain eniplovmenr and rraining sellings, although the issues ot administration tune, val- 
iditv and basic ci>si would need to becaielullv consuleu'd. 

Att iss U I) Rehahiliiaiion and Research C enter. UU l ast :4ih Street. New York* NY 
l(H)IO 

• ♦ ♦ 

hill «»i s>snM NulparC ompuneni Work Sample s>sii III 

1)1 Si KHMh.s sx.icm xMih about 26 work samples ivw use wuh nidustriallv miuied 

WOI kci ^ 
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h^HMM. Sainplos ,„ ,he svston, indudo: small tools. s,/c discrimination, ninuerical 
vMtm^. up,H-t cAtK-n.iu ,an>.c oi mot. m. dciaal comprohonsion and aptitude, indc- 
pcndc.it problem solving, multilevel sortiti};. simulated assen,blv. whole body range of 
•xo't.Mi. If. lovd measuu-me;.i. eu -iMnd loot eoo.d.nat.on. and solder.ng. Ihe work 
sa..,ples wco developed and are intended lot use as individual eoniponents and are 
not uronped as an evaluaiion .vMcni Sepa.ate ottset manuals are provided tot each 
^vork sample liitoimauon on adm.n.stiation. scoiinj. and norms ,s available in the 
uuiiuiaK 

Mv... u, l),vM,...M,s, Ihe Valpai svstem provides individual work satt.ples that 
appeal to be lelativelv easv to adimnistei and score. Individual work samples could be 
easilv uuoiporaled into an cMsiu.. evaluation proi-iam. However, there arc difficul- 
iies ,n that the tom.s and cooidmated information required tor use ol all the 12 satn- 
I'les as ., sv .,a„ a.e not s„pp|u-d Normative inlormation is available, atid some data 
t»n teliabilitv: novalidiiv data appaicntiv are available. 

•\.'.MU Mius Ihe \alpa. would appear to be most usctul m cmplovmeiit and traitiing 
scttni>|s vvhcie ihcie aic a Mcnit.cant number of industr.allv iniured workers to be 
^e.ved I hen the .ntoima.ion provided about range ol motion atid other factors 
included in ih.s sVstem v.ould be ot teal value. 

Voss. \alpai I oipoiation.65.s North .Mvcinon. Smte 108. Tucson. A/ 857 16 



iiiu Ol svsii M \ocalional Inlormation and F%aluation Work Samples (VIF.WS) 
'.). s. Kin K.N Work .ample svstcm especially designed for mentally retarded persons 
1 OHM v. 1 he woik samples m this system are organized according to the Dicnonurv 
ol (hxunaun,H,l /,//... and include samples in elemental, clerical, machine and cratt 
..teas ot vvoik louiteen ot the ^volk samples ate individuallv packaged in portable 
plastu .abuicis Dnil pu-ss and machine-leeding work samples are permanently 
mounted on a stuidv .vo.k .able A comprehensive manual contains all administrative 
Ueia.ls. such as .ol up. evaluaioi and client instructions and scoring procedures Com- 
poi.on o, the ennic .vMem requires 20 ,o .V^ hours. Ihe samples are intended to be 
admiiiMcted bv evaliiatoi . trained spcciticallv in the VU-W S System. 

Ml WS evaliMies the vocational potential of the mentallv retarded for jobs in six 
woike, iiait uioups .u.oiding to the l)()l. Ihis .vstem locuscs on job areas thai arc 
veiv .ommon in the national e.onomv and. more important, lob areas where many 
leia.deJ peisons have toiind success.ul emplovment. Ii also separates learning of skills 
(rom a.iual pe.toiiiiance. and clients arc tirst taught the task thoroughlv. prior toper- 
loiimnc 11 •.mdci iiiiicd condiiioiis tor vocational asscssmeni 

nh.,M..tion. aic nude hv the cv.ilu.ito, as clients pio.u-ss thiou.h the work sam- 
plo I hc.c oh.c.v.mon. ..ic nia.lc on a woik .ample .c.o.d piovul^d with the svstcm. 
M ilK- CM Ol c.Kh J.o \ wo,k. ihcsc obscivai.ons .„c suii.nia.i/cd on a daiK observa- 
lo.ni Mand.,ul,.-cd Kh.uio. obscva.ions aic.onihincd wiih uumus lo, learnm. 
tunc and .(ual. IV oi pci loi m.ukc lo pi oducc a well oigani/cd icpoi i . 
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SfAtit Oh DfcvuoHMi-.sr: Industrial nmc standards. Modular Arrangement of Pre- 
determined lime Standards (MODAFFS). are available as well as normative data on a 
client population. This norm group is currently being expanded to include data from 
some of the 2(K) VltWS systems currently m use throughout the coumry. To date, no 
reliability or validity data have been reported. 

AHHiU ArioN: VltWS would be appropriate for employment and training settings 
where a significant number of mentalU retarded individuals are being served, although • 
the system has not yet been validated. 

Acchss: /vvailable from the VvKational Research Institute. Jewish Hmployment and 
Vocational Service, ITOOSansom Street. Philadelphia, PA 19103 

• • • 

I itii OF S^sitM: Voctttiunai Inierrit Temperament and Aptitude System (VITAS) 

DKscRiHrioN: Work sample system designed explicitly for disadvantaged applicants in 
i I A programs 

hoRMAf: VI IAS is a vivational assessment system. It includes a battery of hands-on 
aciivuies to be used in a simulated work environment. It asses.ses work potential in 
terms of interests, temperaments and aptitudes, as defined by the U.S. Department of 
I abor in as Diaumarv oj ikxuput tonal Titles and its General Aptitude Test Battery. 
Assessment requires two-and-one-half days. One work sample administrator and one 
aide can assess up to five participants at a time. 

Ihv system includes 21 work samples constructed of durable, reusable equipment 
and materials. Software includes report forms and a detailed manual containing stan- 
dardized privedures for setting up, administering and scoring VITAS. A representative 
of each facility purchasing VITAS comes to Philadelphia for a week of training with 
the developer that focuses on worK sample theory and technology, report-writing 
skilK. recording observations, and specific instruction in the administration of each 
VI IAS work sample. .\n optional, extra-cost consultation visit by a representative of 
the developer may aho be obtained for further work in implementing the VITAS bat- 
tery on site. 

There arc five steps in the VI FAS process: ( 1 ) an orientation interview; (2) adminis- 
tration of the work samples; (3) a motivational group session conducted at the end of 
the first day of evaluation to reduce anxiety and increase client motivation: (4) a voca- 
tional interest interview which gives feedback on participants' performance and pro- 
vides a beginning for the counseling process; and (5) report writing lending to final 
vtKational recommendations for consideration by the client's counselor. ViTAS relates 
to 1 5 of the major worker^trait group arrangements in the DOT. 

StAUi- OF Di-vnoF.v4i.si : Normative data are provided, but reliability and validity data 
are not vet available. 

AppiK Anos: VI IAS is one of the few work sample systems that has been developed 
explicitly for use with disadvantaged populations in CTITA programs. It has been ori- 
ented NpecificalU to prov ide the kind of input and to be arranged in the kind of format 
that would make it maximally uselul in an employment and training agency setting. 
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Ihese advantages make it worthy ot serious consideration by such agencies, although it 
IS still 11) an early stage ot development and no data on its actual utility are yet avail- 
able. 

Access; Available from the Wxational Research Institute. Jewish l-imploynient and 
ViK-ational Service. |7(K) Sansom Street. Philadelphia. PA 19103 

* • * 

IitiF o^ Svstuvi: Wide KaiiKe F.inpiu>ment Sample Test (WKF.ST) 

iHscRiPrioN: Work sample system (or primary use with mentally retarded and physi- 
cally handicapped individuals 

KoRMAr: The 10 work samples are: single, double folding, pasting and stuffing; sta- 
pling; bottle packaging; measuring; screw assembly; tag stringing; scratch pasting; col- 
lating; color and shade matching; and pattern making. Each work sample is indepen- 
dent, and a spiral-bound manual wuh photographs presenting system details is avail- 
able. The system may be administered either individually or in groups; administrat'on 
time IS about one-and-one-half hours for a single client; small groups of three to six 
persons take about two hours. For each work sample, the manual describes the purpose 
and gives the materials, scoring information and instructions. A photograph is ased to 
insure proper layout. A summary -of-results form is provided to record performance 
and general remarks; no final report format is specified by the developer. 

SiMii- Of. DfvnoPMfsr: The WREST consists of 10 short, low-level tasks apparently 
j^signod to asses.s mainly the manipulation and dexterity abilities of the client. The 
WREsr has been used primarily in sheltered workshups dealing with mentally retarded 
and physically handicapped clients, usually for initial as.sessment before assignment to 
suitable work projects. There is an emphasis upon repeating the work samples many 
times to provide an evaluation of the client's ability to improve performance under 
repeated practice conditions, a technique especially useful with memally handicapped 
individuals. There are some problems in the system because of the lack of systematic 
behavior observation as part of the work sampling procedure, failure to relate results 
to the competitive job market, and the lack of specification of report procedures so 
that the results of assessment can be conveyed back to counselors or others who would 
need to use them. Some reliability estimates arc presented in the manual materials, and 
there are normative data but these are not identified in terms of what kinds of individ- 
uals are represented. No validity data are available. 

Ahpikmios: The NN RI SI would scem to have somewhat limited utility for employ- 
ment and traininj. agency settings unless an agency were required to serve a significant 
mentally retarde.l population. Then the simple kinds of tasks the battery assesses might 
be relevant to ioh opportunities actually available in the open market. Considerable 
adaptation in i.-rins of developing norms and making these connections to the local job 
market explicit would be required for use of the WREST in an actual agency setting. 

AccKss: Ciuidance Assixiates of Delaware. Inc.. 1526 Gilpin Avenue. Wilmington. DE 
1 ^8t)^> 



35 



40 



Ait^iintaxtrH and DKad^MnUK^s of >%ork Sampling 



lo dale, \alidilv nIuJicn of tdc work saitiplc technique tor asNCvsing the severe- 
1> clisadvaiuaged luixe been eiKourairiiig but liardU coiKlusi\e. Ati unresolved 
i|uesiu)n conceriiiii>! the \\ork sample approach centers on cost benefit: (liven 
that work sample a»es>ineni niav be much moic expensive and tinieconsum* 
mg ihati nuire traditional paper -and-pencil test battery approaches, is the 
increase m mtormation uselul to decision making gieai enough to outweigh 
the increased cost as compared to vUlier alternatives? 

I here aUo are questions regarding wliether tlie success ot work sample sys- 
tems under experimental conditions can be repeated in routine operations. For 
example, consider these alternate explorations for positive results in a l%8 
stud> ot the J. I V.S. svstem: 

1. ( ounsdois weio at the isct given a ''pitch" lor the utility of work sample 
asNessment. which the> musi have believed, ai least in part, since they 
feterred clients to the work sample center not tor experimental purposes 
but because ihev lelt a iiced tor especially comprehensive information on 
given clients (J.I A.S.. 1968, p. 48). Ihus the counselors may have had a 
* 'success sei" tor experimental g' oup subjects that led them lo make more 
iiucnsivc efforts tor this group. 

2. Pan of the benefit to work sample evaluees may have accrued from the 
extra aileniion thev received from the experience of working for pay over a 
peiiod of two weeks or from being a part of a 'Special" program. In the 
M A S. studv . evaluees may have been supported and encouraged substan- 
tiallv bv VISI \ volunte'.Ts who went out looking tor those who did not 
show up at the Center as scheduled. Increases in job productivity as the 
result ot such special attention are a classic finding of studies in work 
behav loi . 

I he question tlien beciwnes: How mucli of the improvement in training 
completion and placement -success rates was due to work sample assessment, 
and how mucli was due to proj^ram circumstances surrounding the evaluation? 
One o\ the benefits claimed for tlie work sample approach is the provision of 
work experience foi clients whose contact with the world of work is quite 
lunited it this Is merelv a 'Mringe benefit'' of relatively minor significance 
i^iunpared to the improved quality of information obtained, then work sample 
assL'ssment mav be justified. On ttie otlier hand, if it is the work experience 
ilsell that induces most of llie improvements in training or placeinent success, 
there mav be tar less *'xpensive ways of providing this benefit, e.g.. by elimi- 
nating the cost of tr; ig and maintaining a work sample evaluation staff. 
Or. a verv small numb< r evaluators may be adequate for collecting data on 
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a large number of enrollees if work experience itself is the most important 
aspect ot the work sample. Only comparative experimental investigations can 
establish the relative contributions of ptwitive work experiences, counselors' 
expectations and work sample assessment results to the overall success of a 
work sample evaluation project. 

It is important that the work sample "package" accurately reflect labor 
market conditions of the employment and training program in question. A 
recurrent complaint about available packages is that they are not adequately 
tailored to reflect local realities, so that one of the important R&D efforts yet 
to be undertaken is a study of how the work sample assessment technique in 
practice can be made more flexible. In principle, samples can be constructed 
tor any job, at least for those involving mostly physical activities and skills. 
F'urther work needs to be done, however, in order to make this assessment 
strategy easily adaptable to local conditions. 

Despite impressive testimonial evidence for the work sample, including its 
enthusiastic endorsement by some employers, there may be some question 
about the general acceptance of the technique for selection decisions An 
employer who is accustomed to a GATB profile may be very suspicious of a 
work sample report based on a measurement method quite different from tra- 
dmon-il papcr-and-pencil tests. Expansion of work sample assessment, there- 
tore, may depend upon efforts to inf orm and convince employers of the tech- 
nique's utility. 

Finally, work sampling may well be most efficient for in-depth vocational 
exploration rather than for specific placement decision making. Two to seven 
weeks of assessment may provide much more information than is necessary for 
many purposes. If. at a particular time, a given employment and training pro- 
gram can place its clients only in a very restricted number of jobs or has a lim- 
ited number of training alternatives to offer, the detailed information pro- 
vided by extensive work sample assessment may be too costly. 

A few very simple tasks may provide the information necessary to make 
valid choices among only a few alternatives. The concept of the work sample 
might be used, therefore, in selecting applicants to be placed on one specific 
lob. l-or example, when selecting janitorial personnel, applicants might simply 
be asked to clean up a room. A supervisor-trainer can point out mistakes after 
watching the applicant's first try and then observe how the individual does on 
a second room. Observations may provide information useful to placement 
decisions. Doubtless there are many ways in which the work sample technique 
could be developed along these lines. Actual utility of such simplified work 
samples would, of course, need to be established through research study. And 
when a greater diversity of opportunities is available (as when improving eco- 
nomic conditions have broadened the job market), work samples used must be 
sufficiently complex to permit finer discriminations to be made. 
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(. omprehcnsive information on the work sample systems discussed in this 
section is available in Botterbusch (1976, 1977). Some general background on 
use of work sampling systems is provided in Dunn (1976. 1977), McDaniel 
(197 K Nadolsky (1973. 1977). and Botterbusch & Sax (1977). The latter pro- 
vides a useful set of considerations for the selection of a commercial voca- 
tional evaluation system. Some of the issues raised here regarding cost effec- 
tiveness of work sample systems are given more thorough discussion in a study 
sponsored by the Vocational Evaluation and Work Adjustment Association 
(1975). 



PRKIKSTIN(; ORIKMAMON MATKRIALS 

lor manv severelv disadvantaged clients, assessment is an anvieiy-provoking 
experience, about which thev may have considerable doubt and suspicion. As 
Seiler ( 1970) has pointed out» high drop-out rates during the early stages of cli- 
ent participation in service programs may, in part» reflect disadvantaged appli- 
cants* rejection of testing. Many of these people perceive assessment as 
unpleasant, incomprehensible, or unrelated to helping them get a job. They do 
not understand the purpose of testing* are unfamiliar with tests and fear 
group-testing situations. Much of their fear may stem from limited but aver- 
sive contacts with tests in school settings or from inability to read items or 
directions phrased at too high a reading level* or both. 

One partial solution to this problem is to give disadvantaged clients some 
type of pretesting orientation. This experience may reduce distorting effects of 
individual differences in familiarity with test content* ability to understand 
directions, or rejection of assessment out of fear or lack of motivation. More- 
over, It may be possible, through such pretesting experiences* to identify indi- 
viduals for whom standard paper-and-pencil tests are inappropriate because of 
low reading levels. These persons may then be guided into alternative assess- 
ment procedures (clinical interview, work sample, etc.) in which their handi- 
caps will not interfere wuh an effort to identify and measure job-related 
personal characteristics. Both the U.S. Hmployment Service and The Psycho- 
logical Corporation have devised pretesting orientation materials, which are 
summari/t'd below . 

• • • 

I nu ov PRh ustiNu ()Rit\iAiu)N M Alt RIM ! Tpst OfieittaUoii Procedure 

Dhst RiPiioN. Practice materials designed to help applicanis learn how lo take tests 

F<^RMAr: The Psvchologicdl Corporations multimedia pretesting orientation materials 
are intended to serve as a preface lo any kind of vocational assessment or selection test- 
ing. I he aim is to reduce anxiety and increase **test wiscness** by offering practice in 



. k.n.« U'^'v 1 he materials, dcs.vjned for jsroup admn.istration. yuidc the group 
l'.ou,h a halt hour >csmo., ot eas. tcst-hke excrcses ,n a 2().page practice- bookkt A 
a,H^uxo.U.„, . used ,o pun.dc. ducctions and .s,I...UoJa^.L:^'S^^'^^^ 
.h s. nl .r tcs, nuua.als . ,h.„ p,,.,,., un turthcr take-honK- practice prior to 
he aa .al .cs„„, cxpononc. I tu-re arc tivc tests ,n all -speed atul accuracy, spelling 

nasi Ktn available tor some >cars through the test publisher. 

mmht'be " ' procedure, the lest Orientation FrcKedure 

" - - -P'">--t and 

A( vhss: Available trom The FNychological Corporation. New York. NY 

• • • 

Inu J>R^ti.sMsc.()R,^s,Mu,s MM.R1AI.: i:SKS Pretesting Orientation Exercises 
l)fs< RiP,,„N: M.tnature test battery for use in pretesting orientation 
roRMAt; I he exercises are administered as a series of short tests whose items resemble 
: r': nJe x'"'^ n-' " -quires about one-and-o ha 

1» ^ v sl^l '7^'^'''' ''^''^ '"'^'^•'^"^'^ possess minimu,^ 

•era.v sktlls tor taking the CATB but who may have little experience with aptitud^ 

liTpanir d, aSa ^d"" T ''''l'' ''''''''' orientation 

provide disadvantaged applicams scheduled to take the GATB with experience in 

Z:::'^:' : r-;^/---^ ---P^-- The exercises are HexibTeno gh 

t^c "uVand h u ' ■ ''7 '""'"'^^'^ ^^^^ ^P'^-f'^' with 

tn. C.AI B and have been applied in many employment and training settings. 

n^Tonh administer the GATB as 

nu J n I ^"""^ "^^''""y ^"^P'^y'^d as part of a 

more general pretesting orientation exercise, 

mem ?f /!h''' w''/''''"*'' / '"P'^'>'"^'"' ^"^ draining Administration. U.S. Depart- 
ment of I abor. NSashmgton. DC 2021 or through state tmployment Service offices 

I'nlh'.nr 'l/''''^'^''"''''' ^r^*'' ^^^"^"'^ ^i" both Spanish and 

ngl, h t or self -onentation - Your Best on Apnmie Tests and D<un, Your Bes, 

« «.W.,. . n,Hnu.u- Feu. A -pretestit^g orientation on the purpose of testing" 
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APPENDIX A 



Summary Chart 
Special Assessment Techniques for the Severely Disadvantaged 

l ollov^ing IS a lisi of all the special ussessineni devices for severely disad- 
vantaged person . reviewed in this volume, l-ach entry includes the num- 
ber ot the page where the device is discussed in the text» and there is also 
a notation ot the mam purpose tor which the technique was devised and 
lis present stage of development. 
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APPKNDIX B 



Resources for Assessment of Disabled Persons 

l^^niployment and training agencies today are serving more physically disabled 
clients than ever before. These clients often require special assessment 
approaches not needed for most other clients. The purpose of this appendix is 
to list some information resources relevant to this subject. 

The l*:mpk>ynient Service recently has published a guidebook » entitled 
Placing Handicapped Applicants: An Employment Service Handbook, for use 
by employment and training agencies concerned with developing services for 
the disabled. The assessment process may be set in better context by referring 
to this handbook, which is available through state Employment Service offices 
or the U.S. hmployment Service. 

The most important single resource for information about assessment of 
disabled individuals is the Materials Development Center (Stout Vocational 
Rehabilitation Institute, University of Wisconsin-Stout, Menomonie, Wiscon- 
sin 54751). This center provides a variety of informational products and ser- 
vu N related to vocational evaluation of physically disabled persons. 

Of special relevance to assessment program developers desiring to imple- 
ment vork sample systems are two publications that have already been men- 
tioned: Botterbusch (1976), A Comparison of Seven Vocational Evaluation 
Systems; and Botterbusch (1977), .4 Comparison of Four Vocational Evalua- 
tion Systems. These publications provide detailed information, including eval- 
uative reviews, of the major work sample systems also described in this 
Manual. Moreover, MDC has available a series of tape/slide presentations on 
13 of the commercial vocational evaluation systems that were described in the 
volume (J.l^V.S., Singer, TOWE:R, etc.). These presentations can be loaned to 
qualified users, rented or purchased. 

Another important reference is Botterbusch (1976), The Use of Psychologi- 
cal Tests With Individuals Who Are Severely Disabled. This helpful guidebook 
is designed to provide vocational evaluators and other professionals with prac- 
tical guidelines for selecting, adapting and administering standardized psycho- 
logical tests to individuals who have sight, hearing and academic handicaps. It 
contains a wealth of information, including standards for making modifica- 
tions and a comprehensive list of references plus addresses of test publishers. 
Botterbusch is also the author of Psychological Testing in Vocational Evalua- 
tion (1978), which includes a background section on the purpose of tests and 
how to select them, along with a careful review of specific tests relevant to 
vocational evaluation. 

The Materials Development Center also is the publisher of Work Evaluation 
and Adjustment: .An .Annotated Bibliography 1947-1977 (Ronald R. Fry, 
1978). This bibliography contains 1,296 annotations and is probably the most 
comprehensive citation reference volume in existence on assessment of the dis- 
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abled. A supplement. Hork Evaluation and Adjustment: An Annotated Bib- 
Imraphy, I97H Supplement, also by Fry and published in 1979, provides a 
further updating ot this literature. Finally. Suggested Publications for Devel- 
oping an Aaemy l ibrary on Hork Evaluation and Work Adjustment (1978) 
suggests 54 essential print references in this area, including 27 available from 
MDC. 

The Materials Development Center offers a range of other services for eligi- 
hie individuals and institutions. Those eligible to receive these services may 
write in to receive loan copies of publications of the Center or of a number of 
other documents contained in their library collection. No employment and 
training agency considering the implementation of a work sample system in its 
assessment function should fail to contact the Materials Development Center- 
it IS a uniquely valuable resource. The Center would be of perhaps less central! 
but still very important, assistance whenever asses.sment of the disabled is a 
concern ot the employment and training agency assessment program. 

Anotner important reference volume for assessment of physically disabled 
individuals is Testing for Impaired, Disabled and Handicapped Individuals 
prepared by the American Alliance for Health. Physical Education and Recre- 
ation (1201 16th Street. N.W .. Washington. DC 20036). This volume provides 
an overview of testing concepts and then describes psychological tests in the 
areas of physical fitness and motor ability, perceptual motor development and 
psychomotor tests, developmental profiles, and several locallv developed 
assessment devices for use with physically disabled persons. 

When more general background information about assessment of disabled 
perNons may be required, the following information sources may be of value: 
IC'D Research L tihzaiion Laboratory 
•UOtast 24tii Street 
New York, NY 10010 

Michigan Rehabilitation Research Institute 
1 yiy School of Education 
L'niscrsity of Michigan 
610 Fast L'niversity 
Ann Arbor. Ml 48 UW 

National Clearing Hou%e of Rehabilitation Training Materials 
Oklahoma State L'niversitv 
1 15 Old L'. S.I). A. Building 
StilUater.OK 740''4 

National Rehabilitation Information Center 
C atholic I'nuersity 
Washington. IX"2(X)64 

These are all clearinghouses funded by the Rehabilitation Services Adminis- 
tration, which compile information on subjects such as program evaluation 
and the vocational rehabilitation process in general. 
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